Loans and Allowance for Loan Losses, Impaired Receivables (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		12 Months Ended
	Mar. 31, 2014		Dec. 31, 2013
Impaired loans by loans class [Abstract]
Recorded Investment	$ 27,911		$ 29,340
Unpaid Principal Balance	32,607		32,595
Related Allowance	0		0
Average Recorded Investment	28,765		26,683
Commercial [Member] | Commercial Real Estate [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	5,248		7,750
Unpaid Principal Balance	7,943		9,169
Related Allowance	0		0
Average Recorded Investment	6,265		7,414
Commercial [Member] | Other [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	122		332
Unpaid Principal Balance	122		332
Related Allowance	0		0
Average Recorded Investment	122		165
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	18,872		17,887
Unpaid Principal Balance	20,345		19,275
Related Allowance	0		0
Average Recorded Investment	18,810		16,317
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	461		561
Unpaid Principal Balance	485		614
Related Allowance	0		0
Average Recorded Investment	521		636
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	3,208		2,810
Unpaid Principal Balance	3,712		3,205
Related Allowance	0		0
Average Recorded Investment	3,047		2,151
New York and Other States [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	25,027	[1]	26,298	[1]
Unpaid Principal Balance	28,719	[1]	29,163	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	25,656	[1]	23,571	[1]
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	4,731	[1]	6,620	[1]
Unpaid Principal Balance	6,813	[1]	8,039	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	5,339	[1]	6,013	[1]
New York and Other States [Member] | Commercial [Member] | Other [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	122	[1]	332	[1]
Unpaid Principal Balance	122	[1]	332	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	122	[1]	165	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	17,140	[1]	16,257	[1]
Unpaid Principal Balance	18,321	[1]	17,353	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	17,076	[1]	14,706	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	461	[1]	561	[1]
Unpaid Principal Balance	485	[1]	614	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	521	[1]	636	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	2,573	[1]	2,528	[1]
Unpaid Principal Balance	2,978	[1]	2,825	[1]
Related Allowance	0	[1]	0	[1]
Average Recorded Investment	2,598	[1]	2,051	[1]
Florida [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	2,884		3,042
Unpaid Principal Balance	3,888		3,432
Related Allowance	0		0
Average Recorded Investment	3,109		3,112
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	517		1,130
Unpaid Principal Balance	1,130		1,130
Related Allowance	0		0
Average Recorded Investment	926		1,401
Florida [Member] | Commercial [Member] | Other [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	0		0
Unpaid Principal Balance	0		0
Related Allowance	0		0
Average Recorded Investment	0		0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	1,732		1,630
Unpaid Principal Balance	2,024		1,922
Related Allowance	0		0
Average Recorded Investment	1,734		1,611
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	0
Unpaid Principal Balance	0
Related Allowance	0
Average Recorded Investment	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Impaired loans by loans class [Abstract]
Recorded Investment	635		282
Unpaid Principal Balance	734		380
Related Allowance	0		0
Average Recorded Investment	$ 449		$ 100

[1] Includes New York, New Jersey, Vermont and Massachusetts.