Loans and Allowance for Loan Losses, Past Due (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		12 Months Ended
	Mar. 31, 2014		Dec. 31, 2013
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	$ 9,005		$ 7,262
60-89 Days Past Due	4,206		3,831
90+ Days Past Due	30,663		28,128
Total 30+ days Past Due	43,874		39,221
Current	2,897,128		2,869,588
Total loans	2,941,002		2,908,809
Loans that are 90 days past due and still accruing interest	0		0
Number of days past due	90 days		90 days
Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	220,443		223,481
Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	466		583
60-89 Days Past Due	215		1,426
90+ Days Past Due	3,432		3,379
Total 30+ days Past Due	4,113		5,388
Current	186,210		185,738
Total loans	190,323		191,126
Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		209
60-89 Days Past Due	0		0
90+ Days Past Due	122		123
Total 30+ days Past Due	122		332
Current	29,998		32,023
Total loans	30,120		32,355
Real Estate Mortgage - 1 to 4 Family [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	2,714,845		2,679,433
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	7,190		5,216
60-89 Days Past Due	3,681		2,042
90+ Days Past Due	23,847		21,853
Total 30+ days Past Due	34,718		29,111
Current	2,287,704		2,258,697
Total loans	2,322,422		2,287,808
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	51		46
60-89 Days Past Due	48		18
90+ Days Past Due	469		552
Total 30+ days Past Due	568		616
Current	51,884		50,520
Total loans	52,452		51,136
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	1,261		1,123
60-89 Days Past Due	253		331
90+ Days Past Due	2,705		2,144
Total 30+ days Past Due	4,219		3,598
Current	335,752		336,891
Total loans	339,971		340,489
Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	37		85
60-89 Days Past Due	9		14
90+ Days Past Due	88		77
Total 30+ days Past Due	134		176
Current	5,580		5,719
Total loans	5,714		5,895
New York and Other States [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	7,878	[1]	6,601	[1]
60-89 Days Past Due	2,736	[1]	3,829	[1]
90+ Days Past Due	27,218	[1]	23,652	[1]
Total 30+ days Past Due	37,832	[1]	34,082	[1]
Current	2,445,196	[1]	2,434,240	[1]
Total loans	2,483,028	[1]	2,468,322	[1]
New York and Other States [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	198,273	[1]	202,045	[1]
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	466	[1]	583	[1]
60-89 Days Past Due	215	[1]	1,426	[1]
90+ Days Past Due	3,432	[1]	3,379	[1]
Total 30+ days Past Due	4,113	[1]	5,388	[1]
Current	164,113	[1]	164,334	[1]
Total loans	168,226	[1]	169,722	[1]
New York and Other States [Member] | Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0	[1]	209	[1]
60-89 Days Past Due	0	[1]	0	[1]
90+ Days Past Due	122	[1]	123	[1]
Total 30+ days Past Due	122	[1]	332	[1]
Current	29,925	[1]	31,991	[1]
Total loans	30,047	[1]	32,323	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	6,108	[1]	4,664	[1]
60-89 Days Past Due	2,215	[1]	2,042	[1]
90+ Days Past Due	20,938	[1]	17,624	[1]
Total 30+ days Past Due	29,261	[1]	24,330	[1]
Current	1,899,108	[1]	1,885,117	[1]
Total loans	1,928,369	[1]	1,909,447	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	29	[1]	46	[1]
60-89 Days Past Due	48	[1]	18	[1]
90+ Days Past Due	469	[1]	552	[1]
Total 30+ days Past Due	546	[1]	616	[1]
Current	47,703	[1]	46,878	[1]
Total loans	48,249	[1]	47,494	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	1,238	[1]	1,014	[1]
60-89 Days Past Due	253	[1]	331	[1]
90+ Days Past Due	2,172	[1]	1,897	[1]
Total 30+ days Past Due	3,663	[1]	3,242	[1]
Current	299,360	[1]	300,802	[1]
Total loans	303,023	[1]	304,044	[1]
New York and Other States [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	37	[1]	85	[1]
60-89 Days Past Due	5	[1]	12	[1]
90+ Days Past Due	85	[1]	77	[1]
Total 30+ days Past Due	127	[1]	174	[1]
Current	4,987	[1]	5,118	[1]
Total loans	5,114	[1]	5,292	[1]
Florida [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	1,127		661
60-89 Days Past Due	1,470		2
90+ Days Past Due	3,445		4,476
Total 30+ days Past Due	6,042		5,139
Current	451,932		435,348
Total loans	457,974		440,487
Florida [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	22,170		21,436
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	0		0
Current	22,097		21,404
Total loans	22,097		21,404
Florida [Member] | Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	0		0
Current	73		32
Total loans	73		32
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	1,082		552
60-89 Days Past Due	1,466		0
90+ Days Past Due	2,909		4,229
Total 30+ days Past Due	5,457		4,781
Current	388,596		373,580
Total loans	394,053		378,361
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	22		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	22		0
Current	4,181		3,642
Total loans	4,203		3,642
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	23		109
60-89 Days Past Due	0		0
90+ Days Past Due	533		247
Total 30+ days Past Due	556		356
Current	36,392		36,089
Total loans	36,948		36,445
Florida [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	4		2
90+ Days Past Due	3		0
Total 30+ days Past Due	7		2
Current	593		601
Total loans	$ 600		$ 603

[1] Includes New York, New Jersey, Vermont and Massachusetts.