Loans and Allowance for Loan Losses, Non-accrual Loans, By Loan Class (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013
Non accrual loans by loan class [Abstract]
Total non-accrual loans	$ 36,970	$ 43,227
Restructured real estate mortgages - 1 to 4 family	155	166
Total nonperforming loans	37,125	43,393
Commercial Real Estate [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	4,743	6,620
Other [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0	332
First Mortgages [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	27,364	31,494
Home Equity Loans [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	520	691
Home Equity Lines of Credit [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	4,247	3,997
Installment [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	96	93
New York and Other States [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	34,057	38,090
Restructured real estate mortgages - 1 to 4 family	155	166
Total nonperforming loans	34,212	38,256
New York and Other States [Member] | Commercial Real Estate [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	4,226	6,620
New York and Other States [Member] | Other [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0	332
New York and Other States [Member] | First Mortgages [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	25,113	26,713
New York and Other States [Member] | Home Equity Loans [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	520	691
New York and Other States [Member] | Home Equity Lines of Credit [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	4,103	3,641
New York and Other States [Member] | Installment [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	95	93
Florida [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	2,913	5,137
Restructured real estate mortgages - 1 to 4 family	0	0
Total nonperforming loans	2,913	5,137
Florida [Member] | Commercial Real Estate [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	517	0
Florida [Member] | Other [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0	0
Florida [Member] | First Mortgages [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	2,251	4,781
Florida [Member] | Home Equity Loans [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0	0
Florida [Member] | Home Equity Lines of Credit [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	144	356
Florida [Member] | Installment [Member]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	$ 1	$ 0