Loans and Allowance for Loan Losses, Impaired Receivables (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		12 Months Ended
	Jun. 30, 2014		Dec. 31, 2013
Impaired loans by loans class [Abstract]
Recorded Investment	$ 27,354		$ 29,340
Unpaid Principal Balance	31,117		32,595
Related Allowance	0		0
Average Recorded Investment	28,013		26,683
Commercial Real Estate [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	5,827		7,750
Unpaid Principal Balance	7,922		9,169
Related Allowance	0		0
Average Recorded Investment	5,873		7,414
Other [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	122		332
Unpaid Principal Balance	122		332
Related Allowance	0		0
Average Recorded Investment	122		165
First Mortgages [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	17,693		17,887
Unpaid Principal Balance	18,871		19,275
Related Allowance	0		0
Average Recorded Investment	18,405		16,317
Home Equity Loans [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	438		561
Unpaid Principal Balance	482		614
Related Allowance	0		0
Average Recorded Investment	492		636
Home Equity Lines of Credit [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	3,274		2,810
Unpaid Principal Balance	3,720		3,205
Related Allowance	0		0
Average Recorded Investment	3,121		2,151
New York and Other States [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	25,001	[1]	26,298	[1]
Unpaid Principal Balance	27,895	[1]	29,163	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	25,221	[1]	23,571	[1]
New York and Other States [Member] | Commercial Real Estate [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	5,310	[1]	6,620	[1]
Unpaid Principal Balance	6,792	[1]	8,039	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	5,152	[1]	6,013	[1]
New York and Other States [Member] | Other [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	122	[1]	332	[1]
Unpaid Principal Balance	122	[1]	332	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	122	[1]	165	[1]
New York and Other States [Member] | First Mortgages [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	16,469	[1]	16,257	[1]
Unpaid Principal Balance	17,463	[1]	17,353	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	16,872	[1]	14,706	[1]
New York and Other States [Member] | Home Equity Loans [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	438	[1]	561	[1]
Unpaid Principal Balance	482	[1]	614	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	492	[1]	636	[1]
New York and Other States [Member] | Home Equity Lines of Credit [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	2,662	[1]	2,528	[1]
Unpaid Principal Balance	3,036	[1]	2,825	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	2,583	[1]	2,051	[1]
Florida [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	2,353		3,042
Unpaid Principal Balance	3,222		3,432
Related Allowance	0		0
Average Recorded Investment	2,792		3,112
Florida [Member] | Commercial Real Estate [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	517		1,130
Unpaid Principal Balance	1,130		1,130
Related Allowance	0		0
Average Recorded Investment	721		1,401
Florida [Member] | Other [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	0		0
Unpaid Principal Balance	0		0
Related Allowance	0		0
Average Recorded Investment	0		0
Florida [Member] | First Mortgages [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	1,224		1,630
Unpaid Principal Balance	1,408		1,922
Related Allowance	0		0
Average Recorded Investment	1,533		1,611
Florida [Member] | Home Equity Loans [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	0
Unpaid Principal Balance	0
Related Allowance	0
Average Recorded Investment	0
Florida [Member] | Home Equity Lines of Credit [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	612		282
Unpaid Principal Balance	684		380
Related Allowance	0		0
Average Recorded Investment	$ 538		$ 100

[1] Includes New York, New Jersey, Vermont and Massachusetts.