Loans and Allowance for Loan Losses, Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2013	Jun. 30, 2012	Jun. 30, 2013	Jun. 30, 2012
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	$ 47,658	$ 48,535	$ 47,927	$ 48,717
Loans charged off [Abstract]
Total loan chargeoffs	2,235	3,655	4,646	7,087
Recoveries of loans previously charged off [Abstract]
Total recoveries	166	138	308	288
Net loans charged off	2,069	3,517	4,338	6,799
Provision for loan losses	2,000	3,000	4,000	6,100
Balance at end of period	47,589	48,018	47,589	48,018
Commercial [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	3,964	3,602	3,771	4,140
Loans charged off [Abstract]
Total loan chargeoffs	49	1,003	399	1,495
Recoveries of loans previously charged off [Abstract]
Total recoveries	1	2	4	13
Net loans charged off	48	1,001	395	1,482
Provision for loan losses	(197)	1,191	343	1,134
Balance at end of period	3,719	3,792	3,719	3,792
Real Estate Mortgage - 1 to 4 Family [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	43,595	44,851	44,069	44,479
Loans charged off [Abstract]
Total loan chargeoffs	2,170	2,630	4,212	5,562
Recoveries of loans previously charged off [Abstract]
Total recoveries	162	121	297	244
Net loans charged off	2,008	2,509	3,915	5,318
Provision for loan losses	2,179	1,805	3,612	4,986
Balance at end of period	43,766	44,147	43,766	44,147
Installment [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	99	82	87	98
Loans charged off [Abstract]
Total loan chargeoffs	16	22	35	30
Recoveries of loans previously charged off [Abstract]
Total recoveries	3	15	7	31
Net loans charged off	13	7	28	(1)
Provision for loan losses	18	4	45	(20)
Balance at end of period	104	79	104	79
New York and Other States [Member]
Loans charged off [Abstract]
Total loan chargeoffs	2,073	2,693	3,979	4,282
Recoveries of loans previously charged off [Abstract]
Total recoveries	126	129	206	269
New York and Other States [Member] | Commercial [Member]
Loans charged off [Abstract]
Total loan chargeoffs	49	715	299	1,039
Recoveries of loans previously charged off [Abstract]
Total recoveries	0	2	2	5
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member]
Loans charged off [Abstract]
Total loan chargeoffs	2,008	1,956	3,645	3,213
Recoveries of loans previously charged off [Abstract]
Total recoveries	123	112	197	233
New York and Other States [Member] | Installment [Member]
Loans charged off [Abstract]
Total loan chargeoffs	16	22	35	30
Recoveries of loans previously charged off [Abstract]
Total recoveries	3	15	7	31
Florida [Member]
Loans charged off [Abstract]
Total loan chargeoffs	162	962	667	2,805
Recoveries of loans previously charged off [Abstract]
Total recoveries	40	9	102	19
Florida [Member] | Commercial [Member]
Loans charged off [Abstract]
Total loan chargeoffs	0	288	100	456
Recoveries of loans previously charged off [Abstract]
Total recoveries	1	0	2	8
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member]
Loans charged off [Abstract]
Total loan chargeoffs	162	674	567	2,349
Recoveries of loans previously charged off [Abstract]
Total recoveries	39	9	100	11
Florida [Member] | Installment [Member]
Loans charged off [Abstract]
Total loan chargeoffs	0	0	0	0
Recoveries of loans previously charged off [Abstract]
Total recoveries	$ 0	$ 0	$ 0	$ 0