Loans and Allowance for Loan Losses, Past Due (Details) (USD $) In Thousands, unless otherwise specified	9 Months Ended		12 Months Ended
	Sep. 30, 2014		Dec. 31, 2013
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	$ 5,599		$ 7,262
60-89 Days Past Due	2,391		3,831
90+ Days Past Due	26,452		28,128
Total 30+ days Past Due	34,442		39,221
Current	3,048,587		2,869,588
Total loans	3,083,029		2,908,809
Loans that are 90 days past due and still accruing interest	0		0
Number of days past due	90 days		90 days
Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	698		583
60-89 Days Past Due	53		1,426
90+ Days Past Due	3,015		3,379
Total 30+ days Past Due	3,766		5,388
Current	188,403		185,738
Total loans	192,169		191,126
Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		209
60-89 Days Past Due	0		0
90+ Days Past Due	0		123
Total 30+ days Past Due	0		332
Current	27,656		32,023
Total loans	27,656		32,355
First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	4,457		5,216
60-89 Days Past Due	2,038		2,042
90+ Days Past Due	20,718		21,853
Total 30+ days Past Due	27,213		29,111
Current	2,426,217		2,258,697
Total loans	2,453,430		2,287,808
Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	74		46
60-89 Days Past Due	0		18
90+ Days Past Due	507		552
Total 30+ days Past Due	581		616
Current	56,140		50,520
Total loans	56,721		51,136
Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	337		1,123
60-89 Days Past Due	254		331
90+ Days Past Due	2,159		2,144
Total 30+ days Past Due	2,750		3,598
Current	343,746		336,891
Total loans	346,496		340,489
Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	33		85
60-89 Days Past Due	46		14
90+ Days Past Due	53		77
Total 30+ days Past Due	132		176
Current	6,425		5,719
Total loans	6,557		5,895
New York and Other States [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	4,952		6,601
60-89 Days Past Due	1,826		3,829
90+ Days Past Due	24,797		23,652
Total 30+ days Past Due	31,575		34,082
Current	2,534,914		2,434,240
Total loans	2,566,489	[1]	2,468,322	[1]
New York and Other States [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	200,052		202,045
New York and Other States [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	698		583
60-89 Days Past Due	53		1,426
90+ Days Past Due	3,015		3,379
Total 30+ days Past Due	3,766		5,388
Current	168,691		164,334
Total loans	172,457	[1]	169,722	[1]
New York and Other States [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		209
60-89 Days Past Due	0		0
90+ Days Past Due	0		123
Total 30+ days Past Due	0		332
Current	27,595		31,991
Total loans	27,595	[1]	32,323	[1]
New York and Other States [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	3,999		4,664
60-89 Days Past Due	1,489		2,042
90+ Days Past Due	19,076		17,624
Total 30+ days Past Due	24,564		24,330
Current	1,978,371		1,885,117
Total loans	2,002,935	[1]	1,909,447	[1]
New York and Other States [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	74		46
60-89 Days Past Due	0		18
90+ Days Past Due	507		552
Total 30+ days Past Due	581		616
Current	50,849		46,878
Total loans	51,430	[1]	47,494	[1]
New York and Other States [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	161		1,014
60-89 Days Past Due	254		331
90+ Days Past Due	2,146		1,897
Total 30+ days Past Due	2,561		3,242
Current	303,577		300,802
Total loans	306,138	[1]	304,044	[1]
New York and Other States [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	20		85
60-89 Days Past Due	30		12
90+ Days Past Due	53		77
Total 30+ days Past Due	103		174
Current	5,831		5,118
Total loans	5,934	[1]	5,292	[1]
Florida [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	647		661
60-89 Days Past Due	565		2
90+ Days Past Due	1,655		4,476
Total 30+ days Past Due	2,867		5,139
Current	513,673		435,348
Total loans	516,540		440,487
Florida [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	19,773		21,436
Florida [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	0		0
Current	19,712		21,404
Total loans	19,712		21,404
Florida [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	0		0
Current	61		32
Total loans	61		32
Florida [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	458		552
60-89 Days Past Due	549		0
90+ Days Past Due	1,642		4,229
Total 30+ days Past Due	2,649		4,781
Current	447,846		373,580
Total loans	450,495		378,361
Florida [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	0		0
Current	5,291		3,642
Total loans	5,291		3,642
Florida [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	176		109
60-89 Days Past Due	0		0
90+ Days Past Due	13		247
Total 30+ days Past Due	189		356
Current	40,169		36,089
Total loans	40,358		36,445
Florida [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	13		0
60-89 Days Past Due	16		2
90+ Days Past Due	0		0
Total 30+ days Past Due	29		2
Current	594		601
Total loans	$ 623		$ 603

[1] Includes New York, New Jersey, Vermont and Massachusetts.