Loans and Allowance for Loan Losses, Past Due (Details) (USD $) In Thousands, unless otherwise specified	9 Months Ended		12 Months Ended
	Sep. 30, 2013		Dec. 31, 2012
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	$ 9,217		$ 8,115
60-89 Days Past Due	2,755		3,322
90+ Days Past Due	29,326		36,609
Total 30+ days Past Due	41,298		48,046
Current	2,793,671		2,636,687
Total loans	2,834,969		2,684,733
Loans that are 90 days past due and still accruing interest	0		0
Number of days past due	90 days		90 days
Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	212,833		219,577
Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	185		0
90+ Days Past Due	3,939		5,923
Total 30+ days Past Due	4,124		5,923
Current	183,346		180,208
Total loans	187,470		186,131
Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	123		4
Total 30+ days Past Due	123		4
Current	25,240		33,442
Total loans	25,363		33,446
Real Estate Mortgage - 1 to 4 Family [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	2,616,242		2,460,577
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	8,299		7,226
60-89 Days Past Due	2,087		2,700
90+ Days Past Due	22,216		26,731
Total 30+ days Past Due	32,602		36,657
Current	2,197,898		2,053,321
Total loans	2,230,500		2,089,978
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	347		177
60-89 Days Past Due	68		216
90+ Days Past Due	349		464
Total 30+ days Past Due	764		857
Current	47,800		35,833
Total loans	48,564		36,690
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	512		663
60-89 Days Past Due	388		379
90+ Days Past Due	2,646		3,486
Total 30+ days Past Due	3,546		4,528
Current	333,632		329,381
Total loans	337,178		333,909
Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	59		49
60-89 Days Past Due	27		27
90+ Days Past Due	53		1
Total 30+ days Past Due	139		77
Current	5,755		4,502
Total loans	5,894		4,579
New York and Other States [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	7,391		7,185
60-89 Days Past Due	2,652		2,841
90+ Days Past Due	25,504		28,078
Total 30+ days Past Due	35,547		38,104
Current	2,381,310		2,317,862
Total loans	2,416,857	[1]	2,355,966	[1]
New York and Other States [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	191,436		200,630
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	185		0
90+ Days Past Due	3,939		3,225
Total 30+ days Past Due	4,124		3,225
Current	161,993		164,024
Total loans	166,117	[1]	167,249	[1]
New York and Other States [Member] | Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	123		4
Total 30+ days Past Due	123		4
Current	25,196		33,377
Total loans	25,319	[1]	33,381	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	6,607		6,364
60-89 Days Past Due	2,009		2,248
90+ Days Past Due	18,636		21,341
Total 30+ days Past Due	27,252		29,953
Current	1,845,182		1,784,261
Total loans	1,872,434	[1]	1,814,214	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	347		177
60-89 Days Past Due	68		216
90+ Days Past Due	349		464
Total 30+ days Past Due	764		857
Current	44,653		34,744
Total loans	45,417	[1]	35,601	[1]
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	387		604
60-89 Days Past Due	363		350
90+ Days Past Due	2,404		3,044
Total 30+ days Past Due	3,154		3,998
Current	299,208		297,340
Total loans	302,362	[1]	301,338	[1]
New York and Other States [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	50		40
60-89 Days Past Due	27		27
90+ Days Past Due	53		0
Total 30+ days Past Due	130		67
Current	5,078		4,116
Total loans	5,208	[1]	4,183	[1]
Florida [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	1,826		930
60-89 Days Past Due	103		481
90+ Days Past Due	3,822		8,531
Total 30+ days Past Due	5,751		9,942
Current	412,361		318,825
Total loans	418,112		328,767
Florida [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	21,397		18,947
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		2,698
Total 30+ days Past Due	0		2,698
Current	21,353		16,184
Total loans	21,353		18,882
Florida [Member] | Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	0		0
Current	44		65
Total loans	44		65
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	1,692		862
60-89 Days Past Due	78		452
90+ Days Past Due	3,580		5,390
Total 30+ days Past Due	5,350		6,704
Current	352,716		269,060
Total loans	358,066		275,764
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	0		0
Current	3,147		1,089
Total loans	3,147		1,089
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	125		59
60-89 Days Past Due	25		29
90+ Days Past Due	242		442
Total 30+ days Past Due	392		530
Current	34,424		32,041
Total loans	34,816		32,571
Florida [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	9		9
60-89 Days Past Due	0		0
90+ Days Past Due	0		1
Total 30+ days Past Due	9		10
Current	677		386
Total loans	$ 686		$ 396

[1] Includes New York, New Jersey, Vermont and Massachusetts.