Loans and Allowance for Loan Losses, Past Due (Details) - USD ($) $ in Thousands		6 Months Ended	12 Months Ended
		Jun. 30, 2015	Dec. 31, 2014
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		$ 27,823	$ 32,700
Current		3,215,125	3,125,632
Total loans		3,242,948	3,158,332
Loans that are 90 days past due and still accruing interest		$ 0	$ 0
Number of days past due		90 days	90 days
30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		$ 4,519	$ 5,737
60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,511	4,620
90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		21,793	22,343
Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans		209,399	223,382
Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,653	3,297
Current		183,226	190,827
Total loans		185,879	194,124
Commercial [Member] | Commercial Real Estate [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		33	618
Commercial [Member] | Commercial Real Estate [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		272	52
Commercial [Member] | Commercial Real Estate [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,348	2,627
Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		3	0
Current		23,517	29,258
Total loans		23,520	29,258
Commercial [Member] | Other [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Commercial [Member] | Other [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Commercial [Member] | Other [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		3	0
Real Estate Mortgage - 1 to 4 Family [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans		3,024,875	2,927,356
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		22,236	26,305
Current		2,588,422	2,491,262
Total loans		2,610,658	2,517,567
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		3,454	4,141
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,026	4,157
Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		17,756	18,007
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		324	537
Current		58,947	57,118
Total loans		59,271	57,655
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		53	141
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		7	59
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		264	337
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,505	2,397
Current		352,441	349,737
Total loans		354,946	352,134
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		943	741
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		177	342
Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,385	1,314
Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		102	164
Current		8,572	7,430
Total loans		8,674	7,594
Installment [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		36	96
Installment [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		29	10
Installment [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		37	58
New York and Other States [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		25,912	30,085
Current		2,609,946	2,582,294
Total loans	[1]	2,635,858	2,612,379
New York and Other States [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		3,813	4,746
New York and Other States [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,419	4,337
New York and Other States [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		20,680	21,002
New York and Other States [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans		193,371	203,988
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,620	3,297
Current		167,337	171,491
Total loans	[1]	169,957	174,788
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	618
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		272	52
New York and Other States [Member] | Commercial [Member] | Commercial Real Estate [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,348	2,627
New York and Other States [Member] | Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		3	0
Current		23,411	29,200
Total loans	[1]	23,414	29,200
New York and Other States [Member] | Commercial [Member] | Other [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
New York and Other States [Member] | Commercial [Member] | Other [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
New York and Other States [Member] | Commercial [Member] | Other [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		3	0
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		20,460	23,996
Current		2,054,988	2,017,144
Total loans	[1]	2,075,448	2,041,140
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,781	3,340
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		937	3,874
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		16,742	16,782
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		324	537
Current		51,533	51,176
Total loans	[1]	51,857	51,713
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		53	141
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		7	59
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		264	337
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		2,406	2,108
Current		305,113	306,656
Total loans	[1]	307,519	308,764
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		943	568
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		177	342
New York and Other States [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,286	1,198
New York and Other States [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		99	147
Current		7,564	6,627
Total loans	[1]	7,663	6,774
New York and Other States [Member] | Installment [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		36	79
New York and Other States [Member] | Installment [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		26	10
New York and Other States [Member] | Installment [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		37	58
Florida [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,911	2,615
Current		605,179	543,338
Total loans		607,090	545,953
Florida [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		706	991
Florida [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		92	283
Florida [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,113	1,341
Florida [Member] | Commercial [Member]
Aging of the recorded investment in past due loans [Abstract]
Total loans		16,028	19,394
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		33	0
Current		15,889	19,336
Total loans		15,922	19,336
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		33	0
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Commercial [Member] | Commercial Real Estate [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Commercial [Member] | Other [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Current		106	58
Total loans		106	58
Florida [Member] | Commercial [Member] | Other [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Commercial [Member] | Other [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Commercial [Member] | Other [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,776	2,309
Current		533,434	474,118
Total loans		535,210	476,427
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		673	801
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		89	283
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | First Mortgages [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		1,014	1,225
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Current		7,414	5,942
Total loans		7,414	5,942
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Loans [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		99	289
Current		47,328	43,081
Total loans		47,427	43,370
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	173
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	0
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member] | Home Equity Lines of Credit [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		99	116
Florida [Member] | Installment [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		3	17
Current		1,008	803
Total loans		1,011	820
Florida [Member] | Installment [Member] | 30 to 59 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		0	17
Florida [Member] | Installment [Member] | 60 to 89 Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		3	0
Florida [Member] | Installment [Member] | 90+ Days Past Due [Member]
Aging of the recorded investment in past due loans [Abstract]
Total 30+ days Past Due		$ 0	$ 0

[1] Includes New York, New Jersey, Vermont and Massachusetts.