Loans and Allowance for Loan Losses, Past Due (Details) (USD $) In Thousands, unless otherwise specified	6 Months Ended		12 Months Ended
	Jun. 30, 2014		Dec. 31, 2013
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	$ 5,094		$ 7,262
60-89 Days Past Due	2,048		3,831
90+ Days Past Due	29,055		28,128
Total 30+ days Past Due	36,197		39,221
Current	2,969,953		2,869,588
Total loans	3,006,150		2,908,809
Loans that are 90 days past due and still accruing interest	0		0
Number of days past due	90 days		90 days
Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	54		583
60-89 Days Past Due	0		1,426
90+ Days Past Due	3,493		3,379
Total 30+ days Past Due	3,547		5,388
Current	186,176		185,738
Total loans	189,723		191,126
Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		209
60-89 Days Past Due	0		0
90+ Days Past Due	122		123
Total 30+ days Past Due	122		332
Current	32,810		32,023
Total loans	32,932		32,355
First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	4,241		5,216
60-89 Days Past Due	1,620		2,042
90+ Days Past Due	22,522		21,853
Total 30+ days Past Due	28,383		29,111
Current	2,354,849		2,258,697
Total loans	2,383,232		2,287,808
Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	57		46
60-89 Days Past Due	56		18
90+ Days Past Due	452		552
Total 30+ days Past Due	565		616
Current	53,703		50,520
Total loans	54,268		51,136
Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	653		1,123
60-89 Days Past Due	334		331
90+ Days Past Due	2,392		2,144
Total 30+ days Past Due	3,379		3,598
Current	336,518		336,891
Total loans	339,897		340,489
Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	89		85
60-89 Days Past Due	38		14
90+ Days Past Due	74		77
Total 30+ days Past Due	201		176
Current	5,897		5,719
Total loans	6,098		5,895
New York and Other States [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	4,320		6,601
60-89 Days Past Due	2,048		3,829
90+ Days Past Due	26,523		23,652
Total 30+ days Past Due	32,891		34,082
Current	2,484,853		2,434,240
Total loans	2,517,744	[1]	2,468,322	[1]
New York and Other States [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	200,679		202,045
New York and Other States [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	54		583
60-89 Days Past Due	0		1,426
90+ Days Past Due	3,493		3,379
Total 30+ days Past Due	3,547		5,388
Current	164,268		164,334
Total loans	167,815		169,722
New York and Other States [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		209
60-89 Days Past Due	0		0
90+ Days Past Due	122		123
Total 30+ days Past Due	122		332
Current	32,742		31,991
Total loans	32,864		32,323
New York and Other States [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	3,515		4,664
60-89 Days Past Due	1,620		2,042
90+ Days Past Due	20,018		17,624
Total 30+ days Past Due	25,153		24,330
Current	1,935,515		1,885,117
Total loans	1,960,668		1,909,447
New York and Other States [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	57		46
60-89 Days Past Due	56		18
90+ Days Past Due	452		552
Total 30+ days Past Due	565		616
Current	49,130		46,878
Total loans	49,695		47,494
New York and Other States [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	619		1,014
60-89 Days Past Due	334		331
90+ Days Past Due	2,364		1,897
Total 30+ days Past Due	3,317		3,242
Current	297,919		300,802
Total loans	301,236		304,044
New York and Other States [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	75		85
60-89 Days Past Due	38		12
90+ Days Past Due	74		77
Total 30+ days Past Due	187		174
Current	5,279		5,118
Total loans	5,466		5,292
Florida [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	774		661
60-89 Days Past Due	0		2
90+ Days Past Due	2,532		4,476
Total 30+ days Past Due	3,306		5,139
Current	485,100		435,348
Total loans	488,406		440,487
Florida [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans	21,976		21,436
Florida [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	0		0
Current	21,908		21,404
Total loans	21,908		21,404
Florida [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	0		0
Current	68		32
Total loans	68		32
Florida [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	726		552
60-89 Days Past Due	0		0
90+ Days Past Due	2,504		4,229
Total 30+ days Past Due	3,230		4,781
Current	419,334		373,580
Total loans	422,564		378,361
Florida [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	0		0
60-89 Days Past Due	0		0
90+ Days Past Due	0		0
Total 30+ days Past Due	0		0
Current	4,573		3,642
Total loans	4,573		3,642
Florida [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	34		109
60-89 Days Past Due	0		0
90+ Days Past Due	28		247
Total 30+ days Past Due	62		356
Current	38,599		36,089
Total loans	38,661		36,445
Florida [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
30-59 Days Past Due	14		0
60-89 Days Past Due	0		2
90+ Days Past Due	0		0
Total 30+ days Past Due	14		2
Current	618		601
Total loans	$ 632		$ 603

[1] Includes New York, New Jersey, Vermont and Massachusetts.