Loans and Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2013		Dec. 31, 2012
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	$ 2,834,969		$ 2,684,733
Less: Allowance for loan losses	47,722		47,927
Net loans	2,787,247		2,636,806
Non accrual loans by loan class [Abstract]
Total non-accrual loans	41,556		52,446
Restructured real estate mortgages - 1 to 4 family	170		231
Total nonperforming loans	41,726		52,677
Commercial [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	212,833		219,577
Commercial [Member] | Commercial Real Estate [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	187,470		186,131
Non accrual loans by loan class [Abstract]
Total non-accrual loans	5,313		9,209
Commercial [Member] | Other [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	25,363		33,446
Non accrual loans by loan class [Abstract]
Total non-accrual loans	123		124
Real Estate Mortgage - 1 to 4 Family [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	2,616,242		2,460,577
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	2,230,500		2,089,978
Non accrual loans by loan class [Abstract]
Total non-accrual loans	31,345		37,648
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	48,564		36,690
Non accrual loans by loan class [Abstract]
Total non-accrual loans	499		694
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	337,178		333,909
Non accrual loans by loan class [Abstract]
Total non-accrual loans	4,205		4,764
Installment [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	5,894		4,579
Non accrual loans by loan class [Abstract]
Total non-accrual loans	71		7
Real Estate Construction Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	31,400		37,200
Residential Borrowers [Member] | First Mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	11,700		16,400
Commercial Borrowers Residential Purpose [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	19,700		20,800
New York and Other States [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	2,416,857	[1]	2,355,966	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	36,150	[1]	41,927	[1]
Restructured real estate mortgages - 1 to 4 family	170	[1]	231	[1]
Total nonperforming loans	36,320	[1]	42,158	[1]
New York and Other States [Member] | Commercial [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	191,436		200,630
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	166,117	[1]	167,249	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	5,313	[1]	6,511	[1]
New York and Other States [Member] | Commercial [Member] | Other [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	25,319	[1]	33,381	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	123	[1]	124	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	1,872,434	[1]	1,814,214	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	26,270	[1]	30,329	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	45,417	[1]	35,601	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	499	[1]	694	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	302,362	[1]	301,338	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	3,874	[1]	4,263	[1]
New York and Other States [Member] | Installment [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	5,208	[1]	4,183	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	71	[1]	6	[1]
Florida [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	418,112		328,767
Non accrual loans by loan class [Abstract]
Total non-accrual loans	5,406		10,519
Restructured real estate mortgages - 1 to 4 family	0		0
Total nonperforming loans	5,406		10,519
Florida [Member] | Commercial [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	21,397		18,947
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	21,353		18,882
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0		2,698
Florida [Member] | Commercial [Member] | Other [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	44		65
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0		0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	358,066		275,764
Non accrual loans by loan class [Abstract]
Total non-accrual loans	5,075		7,319
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	3,147		1,089
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0		0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	34,816		32,571
Non accrual loans by loan class [Abstract]
Total non-accrual loans	331		501
Florida [Member] | Installment [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	686		396
Non accrual loans by loan class [Abstract]
Total non-accrual loans	$ 0		$ 1

[1] Includes New York, New Jersey, Vermont and Massachusetts.