Loans and Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2013		Dec. 31, 2012
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	$ 2,762,426		$ 2,684,733
Less: Allowance for loan losses	47,589		47,927
Net loans	2,714,837		2,636,806
Non accrual loans by loan class [Abstract]
Total non-accrual loans	43,268		52,446
Restructured real estate mortgages - 1 to 4 family	174		231
Total nonperforming loans	43,442		52,677
Commercial [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	216,977		219,577
Commercial [Member] | Commercial Real Estate [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	189,678		186,131
Non accrual loans by loan class [Abstract]
Total non-accrual loans	6,351		9,209
Commercial [Member] | Other [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	27,299		33,446
Non accrual loans by loan class [Abstract]
Total non-accrual loans	123		124
Real Estate Mortgage - 1 to 4 Family [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	2,539,905		2,460,577
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	2,163,615		2,089,978
Non accrual loans by loan class [Abstract]
Total non-accrual loans	31,731		37,648
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	41,719		36,690
Non accrual loans by loan class [Abstract]
Total non-accrual loans	549		694
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	334,571		333,909
Non accrual loans by loan class [Abstract]
Total non-accrual loans	4,478		4,764
Installment [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	5,544		4,579
Non accrual loans by loan class [Abstract]
Total non-accrual loans	36		7
Real Estate Construction Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	35,500		37,200
Residential Borrowers [Member] | First Mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	15,500		16,400
Commercial Borrowers Residential Purpose [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	20,000		20,800
New York and Other States [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	2,374,209	[1]	2,355,966	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	36,663	[1]	41,927	[1]
Restructured real estate mortgages - 1 to 4 family	174	[1]	231	[1]
Total nonperforming loans	36,837	[1]	42,158	[1]
New York and Other States [Member] | Commercial [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	195,556		200,630
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	168,308	[1]	167,249	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	5,768	[1]	6,511	[1]
New York and Other States [Member] | Commercial [Member] | Other [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	27,248	[1]	33,381	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	123	[1]	124	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	1,833,212	[1]	1,814,214	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	26,219	[1]	30,329	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	39,508	[1]	35,601	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	549	[1]	694	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	301,023	[1]	301,338	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	3,968	[1]	4,263	[1]
New York and Other States [Member] | Installment [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	4,910	[1]	4,183	[1]
Non accrual loans by loan class [Abstract]
Total non-accrual loans	36	[1]	6	[1]
Florida [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	388,217		328,767
Non accrual loans by loan class [Abstract]
Total non-accrual loans	6,605		10,519
Restructured real estate mortgages - 1 to 4 family	0		0
Total nonperforming loans	6,605		10,519
Florida [Member] | Commercial [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	21,421		18,947
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	21,370		18,882
Non accrual loans by loan class [Abstract]
Total non-accrual loans	583		2,698
Florida [Member] | Commercial [Member] | Other [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	51		65
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0		0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	330,403		275,764
Non accrual loans by loan class [Abstract]
Total non-accrual loans	5,512		7,319
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	2,211		1,089
Non accrual loans by loan class [Abstract]
Total non-accrual loans	0		0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	33,548		32,571
Non accrual loans by loan class [Abstract]
Total non-accrual loans	510		501
Florida [Member] | Installment [Member]
Loans and Leases Receivable, Net Amount [Abstract]
Total loans, net	634		396
Non accrual loans by loan class [Abstract]
Total non-accrual loans	$ 0		$ 1

[1] Includes New York, New Jersey, Vermont and Massachusetts.