Loans and Allowance for Loan Losses, Non-accrual Loans, By Loan Class (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2014		Dec. 31, 2013
Non accrual loans by loan class [Abstract]
Total non-accrual loans	$ 44,745		$ 43,227
Restructured real estate mortgages - 1 to 4 family	162		166
Total nonperforming loans	44,907		43,393
Commercial [Member] | Commercial Real Estate [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	5,248		6,620
Commercial [Member] | Other [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	122		332
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	33,724		31,494
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	663		691
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	4,878		3,997
Installment [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	110		93
New York and Other States [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	39,553	[1]	38,090	[1]
Restructured real estate mortgages - 1 to 4 family	162	[1]	166	[1]
Total nonperforming loans	39,715	[1]	38,256	[1]
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	4,731	[1]	6,620	[1]
New York and Other States [Member] | Commercial [Member] | Other [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	122	[1]	332	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	29,589	[1]	26,713	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	663	[1]	691	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	4,345	[1]	3,641	[1]
New York and Other States [Member] | Installment [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	103	[1]	93	[1]
Florida [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	5,192		5,137
Restructured real estate mortgages - 1 to 4 family	0		0
Total nonperforming loans	5,192		5,137
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	517		0
Florida [Member] | Commercial [Member] | Other [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0		0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	4,135		4,781
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0		0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	533		356
Florida [Member] | Installment [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	$ 7		$ 0

[1] Includes New York, New Jersey, Vermont and Massachusetts.