Loans and Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2012	Dec. 31, 2011
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	$ 2,559,621	$ 2,521,303
Less: Allowance for loan losses	48,018	48,717
Net loans	2,511,603	2,472,586
Non accrual status by loan class [Abstract]
Total nonperforming loans	2,559,621	2,521,303
Commercial [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	235,347	248,163
Non accrual status by loan class [Abstract]
Total nonperforming loans	235,347	248,163
Commercial [Member] | Commercial real estate [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	208,061	214,327
Non accrual status by loan class [Abstract]
Total nonperforming loans	208,061	214,327
Commercial [Member] | Other [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	27,286	33,836
Non accrual status by loan class [Abstract]
Total nonperforming loans	27,286	33,836
Real estate mortgage - 1 to 4 family [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	2,320,203	2,268,989
Non accrual status by loan class [Abstract]
Total nonperforming loans	2,320,203	2,268,989
Real estate mortgage - 1 to 4 family [Member] | First mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	1,961,566	1,908,645
Non accrual status by loan class [Abstract]
Total nonperforming loans	1,961,566	1,908,645
Real estate mortgage - 1 to 4 family [Member] | Home equity loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	41,480	47,306
Non accrual status by loan class [Abstract]
Total nonperforming loans	41,480	47,306
Real estate mortgage - 1 to 4 family [Member] | Home equity lines of credit [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	317,157	313,038
Non accrual status by loan class [Abstract]
Total nonperforming loans	317,157	313,038
Installment [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	4,071	4,151
Non accrual status by loan class [Abstract]
Total nonperforming loans	4,071	4,151
Real Estate Construction Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	35,300	32,500
Non accrual status by loan class [Abstract]
Total nonperforming loans	35,300	32,500
Residential Borrowers [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	12,900	11,600
Non accrual status by loan class [Abstract]
Total nonperforming loans	12,900	11,600
Commercial Borrowers Residential Purpose [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	22,400	20,900
Non accrual status by loan class [Abstract]
Total nonperforming loans	22,400	20,900
Nonperforming Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	51,457	48,778
Non accrual status by loan class [Abstract]
Total non-accrual loans	51,214	48,466
Other real estate mortgages - 1 to 4 family	243	312
Total nonperforming loans	51,457	48,778
Nonperforming Loans [Member] | Commercial [Member] | Commercial real estate [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	13,965	9,968
Nonperforming Loans [Member] | Commercial [Member] | Other [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	126	13
Nonperforming Loans [Member] | Real estate mortgage - 1 to 4 family [Member] | First mortgages [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	32,821	34,254
Nonperforming Loans [Member] | Real estate mortgage - 1 to 4 family [Member] | Home equity loans [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	624	1,025
Nonperforming Loans [Member] | Real estate mortgage - 1 to 4 family [Member] | Home equity lines of credit [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	3,676	3,203
Nonperforming Loans [Member] | Installment [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	2	3
New York and other states [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	2,299,971	2,289,884
Non accrual status by loan class [Abstract]
Total nonperforming loans	2,299,971	2,289,884
New York and other states [Member] | Commercial [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Net loans	210,535	222,927
New York and other states [Member] | Commercial [Member] | Commercial real estate [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	183,365	189,101
Net loans	183,365	189,193
Non accrual status by loan class [Abstract]
Total nonperforming loans	183,365	189,101
New York and other states [Member] | Commercial [Member] | Other [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	27,170	33,734
Net loans	27,170	33,734
Non accrual status by loan class [Abstract]
Total nonperforming loans	27,170	33,734
New York and other states [Member] | Real estate mortgage - 1 to 4 family [Member] | First mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	1,756,019	1,731,127
Non accrual status by loan class [Abstract]
Total nonperforming loans	1,756,019	1,731,127
New York and other states [Member] | Real estate mortgage - 1 to 4 family [Member] | Home equity loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	40,493	46,082
Non accrual status by loan class [Abstract]
Total nonperforming loans	40,493	46,082
New York and other states [Member] | Real estate mortgage - 1 to 4 family [Member] | Home equity lines of credit [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	288,915	285,762
Non accrual status by loan class [Abstract]
Total nonperforming loans	288,915	285,762
New York and other states [Member] | Installment [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	4,009	4,078
Non accrual status by loan class [Abstract]
Total nonperforming loans	4,009	4,078
New York and other states [Member] | Nonperforming Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	35,067	33,116
Non accrual status by loan class [Abstract]
Total non-accrual loans	34,824	32,804
Other real estate mortgages - 1 to 4 family	243	312
Total nonperforming loans	35,067	33,116
New York and other states [Member] | Nonperforming Loans [Member] | Commercial [Member] | Commercial real estate [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	5,530	4,968
New York and other states [Member] | Nonperforming Loans [Member] | Commercial [Member] | Other [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	126	13
New York and other states [Member] | Nonperforming Loans [Member] | Real estate mortgage - 1 to 4 family [Member] | First mortgages [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	25,296	24,392
New York and other states [Member] | Nonperforming Loans [Member] | Real estate mortgage - 1 to 4 family [Member] | Home equity loans [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	582	968
New York and other states [Member] | Nonperforming Loans [Member] | Real estate mortgage - 1 to 4 family [Member] | Home equity lines of credit [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	3,289	2,460
New York and other states [Member] | Nonperforming Loans [Member] | Installment [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	1	3
Florida [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	259,650	231,419
Non accrual status by loan class [Abstract]
Total nonperforming loans	259,650	231,419
Florida [Member] | Commercial [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Net loans	24,812	25,236
Florida [Member] | Commercial [Member] | Commercial real estate [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	24,696	25,226
Net loans	24,696	25,134
Non accrual status by loan class [Abstract]
Total nonperforming loans	24,696	25,226
Florida [Member] | Commercial [Member] | Other [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	116	102
Net loans	116	102
Non accrual status by loan class [Abstract]
Total nonperforming loans	116	102
Florida [Member] | Real estate mortgage - 1 to 4 family [Member] | First mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	205,547	177,518
Non accrual status by loan class [Abstract]
Total nonperforming loans	205,547	177,518
Florida [Member] | Real estate mortgage - 1 to 4 family [Member] | Home equity loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	987	1,224
Non accrual status by loan class [Abstract]
Total nonperforming loans	987	1,224
Florida [Member] | Real estate mortgage - 1 to 4 family [Member] | Home equity lines of credit [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	28,242	27,276
Non accrual status by loan class [Abstract]
Total nonperforming loans	28,242	27,276
Florida [Member] | Installment [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	62	73
Non accrual status by loan class [Abstract]
Total nonperforming loans	62	73
Florida [Member] | Nonperforming Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	16,390	15,662
Non accrual status by loan class [Abstract]
Total non-accrual loans	16,390	15,662
Other real estate mortgages - 1 to 4 family	0	0
Total nonperforming loans	16,390	15,662
Florida [Member] | Nonperforming Loans [Member] | Commercial [Member] | Commercial real estate [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	8,435	5,000
Florida [Member] | Nonperforming Loans [Member] | Commercial [Member] | Other [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	0	0
Florida [Member] | Nonperforming Loans [Member] | Real estate mortgage - 1 to 4 family [Member] | First mortgages [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	7,525	9,862
Florida [Member] | Nonperforming Loans [Member] | Real estate mortgage - 1 to 4 family [Member] | Home equity loans [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	42	57
Florida [Member] | Nonperforming Loans [Member] | Real estate mortgage - 1 to 4 family [Member] | Home equity lines of credit [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	387	743
Florida [Member] | Nonperforming Loans [Member] | Installment [Member]
Non accrual status by loan class [Abstract]
Total non-accrual loans	$ 1	$ 0