Loans and Allowance for Loan Losses, Past Due (Details) - USD ($) $ in Thousands		6 Months Ended	12 Months Ended
		Jun. 30, 2016	Dec. 31, 2015
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		$ 23,120	$ 25,972
Current		3,320,074	3,267,332
Total loans		3,343,194	3,293,304
Loans that are 90 days past due and still accruing interest		$ 0	$ 0
Number of days past due		90 days	90 days
30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		$ 3,635	$ 5,805
60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,126	2,552
90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		17,359	17,615
Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans		195,698	203,415
Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,744	2,350
Current		169,678	173,523
Total loans		172,422	175,873
Commercial [Member] | Commercial Real Estate [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		580	10
Commercial [Member] | Commercial Real Estate [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		104	0
Commercial [Member] | Commercial Real Estate [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,060	2,340
Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Current		23,276	27,542
Total loans		23,276	27,542
Commercial [Member] | Other [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Commercial [Member] | Other [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Commercial [Member] | Other [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Real Estate Mortgage - 1 to 4 Family [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans		3,139,020	3,080,498
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		17,794	20,674
Current		2,702,324	2,639,998
Total loans		2,720,118	2,660,672
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,421	4,986
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,846	2,308
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		13,527	13,380
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		176	192
Current		66,657	60,309
Total loans		66,833	60,501
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		109	43
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2	0
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		65	149
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,308	2,593
Current		349,761	356,732
Total loans		352,069	359,325
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		505	731
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		141	204
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,662	1,658
Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		98	163
Current		8,378	9,228
Total loans		8,476	9,391
Installment [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		20	35
Installment [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		33	40
Installment [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		45	88
New York and Other States [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		20,944	23,754
Current		2,641,333	2,627,033
Total loans	[1]	2,662,277	2,650,787
New York and Other States [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,996	4,970
New York and Other States [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,905	2,260
New York and Other States [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		16,043	16,524
New York and Other States [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans		181,346	188,414
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,744	2,340
Current		155,406	158,625
Total loans	[1]	158,150	160,965
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		580	0
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		104	0
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,060	2,340
New York and Other States [Member] | Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Current		23,196	27,449
Total loans	[1]	23,196	27,449
New York and Other States [Member] | Commercial [Member] | Other [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
New York and Other States [Member] | Commercial [Member] | Other [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
New York and Other States [Member] | Commercial [Member] | Other [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		15,965	18,887
Current		2,100,541	2,075,070
Total loans	[1]	2,116,506	2,093,957
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,896	4,321
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,678	2,037
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		12,391	12,529
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		176	192
Current		56,404	52,059
Total loans	[1]	56,580	52,251
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		109	43
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2	0
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		65	149
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,965	2,194
Current		298,987	305,971
Total loans	[1]	300,952	308,165
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		392	572
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		91	204
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,482	1,418
New York and Other States [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		94	141
Current		6,799	7,859
Total loans	[1]	6,893	8,000
New York and Other States [Member] | Installment [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		19	34
New York and Other States [Member] | Installment [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		30	19
New York and Other States [Member] | Installment [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		45	88
Florida [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,176	2,218
Current		678,741	640,299
Total loans		680,917	642,517
Florida [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		639	835
Florida [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		221	292
Florida [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,316	1,091
Florida [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans		14,352	15,001
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	10
Current		14,272	14,898
Total loans		14,272	14,908
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	10
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Current		80	93
Total loans		80	93
Florida [Member] | Commercial [Member] | Other [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Commercial [Member] | Other [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Commercial [Member] | Other [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,829	1,787
Current		601,783	564,928
Total loans		603,612	566,715
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		525	665
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		168	271
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,136	851
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Current		10,253	8,250
Total loans		10,253	8,250
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		343	399
Current		50,774	50,761
Total loans		51,117	51,160
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		113	159
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		50	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		180	240
Florida [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		4	22
Current		1,579	1,369
Total loans		1,583	1,391
Florida [Member] | Installment [Member] | 30-59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1	1
Florida [Member] | Installment [Member] | 60-89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		3	21
Florida [Member] | Installment [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		$ 0	$ 0

[1] Includes New York, New Jersey, Vermont and Massachusetts.