Loans and Allowance for Loan Losses, Impaired Receivables (Details) (USD $) In Thousands, unless otherwise specified	9 Months Ended	12 Months Ended
	Sep. 30, 2014	Dec. 31, 2013
Impaired loans by loans class [Abstract]
Recorded Investment	$ 27,670	$ 29,340
Unpaid Principal Balance	31,582	32,595
Related Allowance	0	0
Average Recorded Investment	27,941	26,683
Commercial Real Estate [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	5,043	7,750
Unpaid Principal Balance	7,142	9,169
Related Allowance	0	0
Average Recorded Investment	5,631	7,414
Other [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	0	332
Unpaid Principal Balance	0	332
Related Allowance	0	0
Average Recorded Investment	82	165
First Mortgages [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	18,935	17,887
Unpaid Principal Balance	20,200	19,275
Related Allowance	0	0
Average Recorded Investment	18,582	16,317
Home Equity Loans [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	440	561
Unpaid Principal Balance	484	614
Related Allowance	0	0
Average Recorded Investment	476	636
Home Equity Lines of Credit [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	3,252	2,810
Unpaid Principal Balance	3,756	3,205
Related Allowance	0	0
Average Recorded Investment	3,170	2,151
New York and Other States [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	25,250	26,298
Unpaid Principal Balance	28,216	29,163
Related Allowance	0	0
Average Recorded Investment	25,271	23,571
New York and Other States [Member] | Commercial Real Estate [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	4,526	6,620
Unpaid Principal Balance	6,012	8,039
Related Allowance	0	0
Average Recorded Investment	4,978	6,013
New York and Other States [Member] | Other [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	0	332
Unpaid Principal Balance	0	332
Related Allowance	0	0
Average Recorded Investment	82	165
New York and Other States [Member] | First Mortgages [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	17,657	16,257
Unpaid Principal Balance	18,738	17,353
Related Allowance	0	0
Average Recorded Investment	17,131	14,706
New York and Other States [Member] | Home Equity Loans [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	440	561
Unpaid Principal Balance	484	614
Related Allowance	0	0
Average Recorded Investment	476	636
New York and Other States [Member] | Home Equity Lines of Credit [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	2,627	2,528
Unpaid Principal Balance	2,982	2,825
Related Allowance	0	0
Average Recorded Investment	2,604	2,051
Florida [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	2,420	3,042
Unpaid Principal Balance	3,366	3,432
Related Allowance	0	0
Average Recorded Investment	2,670	3,112
Florida [Member] | Commercial Real Estate [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	517	1,130
Unpaid Principal Balance	1,130	1,130
Related Allowance	0	0
Average Recorded Investment	653	1,401
Florida [Member] | Other [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	0	0
Unpaid Principal Balance	0	0
Related Allowance	0	0
Average Recorded Investment	0	0
Florida [Member] | First Mortgages [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	1,278	1,630
Unpaid Principal Balance	1,462	1,922
Related Allowance	0	0
Average Recorded Investment	1,451	1,611
Florida [Member] | Home Equity Loans [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	0
Unpaid Principal Balance	0
Related Allowance	0
Average Recorded Investment	0
Florida [Member] | Home Equity Lines of Credit [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	625	282
Unpaid Principal Balance	774	380
Related Allowance	0	0
Average Recorded Investment	$ 566	$ 100