Loans and Allowance for Loan Losses, Allowance for Loan Losses (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2012	Jun. 30, 2011	Jun. 30, 2012	Jun. 30, 2011	Dec. 31, 2011
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	$ 48,535	$ 43,680	$ 48,717	$ 41,911
Loans charged off [Abstract]
Total loan chargeoffs	3,655	3,196	7,087	6,151
Recoveries of loans previously charged off [Abstract]
Total recoveries	138	227	288	351
Net loans charged off	3,517	2,969	6,799	5,800
Provision for loan losses	3,000	4,850	6,100	9,450
Balance at end of period	48,018	45,561	48,018	45,561
Allowance for loan losses [Abstract]
Individually evaluated for impairment	0		0		0
Collectively evaluated for impairment	48,018		48,018		48,717
Total ending allowance balance	48,018	45,561	48,018	45,561
Loans [Abstract]
Individually evaluated for impairment	19,042		19,042		13,711
Collectively evaluated for impairment	2,540,579		2,540,579		2,507,592
Total ending loans balance	2,559,621		2,559,621		2,521,303
Commercial [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	3,602	4,150	4,140	4,227
Loans charged off [Abstract]
Total loan chargeoffs	1,003	619	1,495	669
Recoveries of loans previously charged off [Abstract]
Total recoveries	2	52	13	55
Net loans charged off	1,001	567	1,482	614
Provision for loan losses	1,191	581	1,134	551
Balance at end of period	3,792	4,164	3,792	4,164
Allowance for loan losses [Abstract]
Individually evaluated for impairment	0		0		0
Collectively evaluated for impairment	3,792		3,792		4,140
Total ending allowance balance	3,792	4,164	3,792	4,164
Loans [Abstract]
Individually evaluated for impairment	14,091		14,091		9,981
Collectively evaluated for impairment	221,256		221,256		238,182
Total ending loans balance	235,347		235,347		248,163
Real Estate Mortgage - 1 to 4 Family [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	44,851	39,336	44,479	37,448
Loans charged off [Abstract]
Total loan chargeoffs	2,630	2,551	5,562	5,433
Recoveries of loans previously charged off [Abstract]
Total recoveries	121	157	244	264
Net loans charged off	2,509	2,394	5,318	5,169
Provision for loan losses	1,805	4,302	4,986	8,965
Balance at end of period	44,147	41,244	44,147	41,244
Allowance for loan losses [Abstract]
Individually evaluated for impairment	0		0		0
Collectively evaluated for impairment	44,147		44,147		44,479
Total ending allowance balance	44,147	41,244	44,147	41,244
Loans [Abstract]
Individually evaluated for impairment	4,951		4,951		3,730
Collectively evaluated for impairment	2,315,252		2,315,252		2,265,259
Total ending loans balance	2,320,203		2,320,203		2,268,989
Installment [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	82	194	98	236
Loans charged off [Abstract]
Total loan chargeoffs	22	26	30	49
Recoveries of loans previously charged off [Abstract]
Total recoveries	15	18	31	32
Net loans charged off	7	8	(1)	17
Provision for loan losses	4	(33)	(20)	(66)
Balance at end of period	79	153	79	153
Allowance for loan losses [Abstract]
Individually evaluated for impairment	0		0		0
Collectively evaluated for impairment	79		79		98
Total ending allowance balance	79	153	79	153
Loans [Abstract]
Individually evaluated for impairment	0		0		0
Collectively evaluated for impairment	4,071		4,071		4,151
Total ending loans balance	4,071		4,071		4,151
New York and other states [Member]
Loans charged off [Abstract]
Total loan chargeoffs	2,693	855	4,282	1,932
Recoveries of loans previously charged off [Abstract]
Total recoveries	129	200	269	319
Loans [Abstract]
Total ending loans balance	2,299,971		2,299,971		2,289,884
New York and other states [Member] | Commercial [Member]
Loans charged off [Abstract]
Total loan chargeoffs	715	19	1,039	69
Recoveries of loans previously charged off [Abstract]
Total recoveries	2	51	5	51
New York and other states [Member] | Real Estate Mortgage - 1 to 4 Family [Member]
Loans charged off [Abstract]
Total loan chargeoffs	1,956	810	3,213	1,815
Recoveries of loans previously charged off [Abstract]
Total recoveries	112	131	233	237
New York and other states [Member] | Installment [Member]
Loans charged off [Abstract]
Total loan chargeoffs	22	26	30	48
Recoveries of loans previously charged off [Abstract]
Total recoveries	15	18	31	31
Loans [Abstract]
Total ending loans balance	4,009		4,009		4,078
Florida [Member]
Loans charged off [Abstract]
Total loan chargeoffs	962	2,341	2,805	4,219
Recoveries of loans previously charged off [Abstract]
Total recoveries	9	27	19	32
Loans [Abstract]
Total ending loans balance	259,650		259,650		231,419
Florida [Member] | Commercial [Member]
Loans charged off [Abstract]
Total loan chargeoffs	288	600	456	600
Recoveries of loans previously charged off [Abstract]
Total recoveries	0	1	8	4
Florida [Member] | Real Estate Mortgage - 1 to 4 Family [Member]
Loans charged off [Abstract]
Total loan chargeoffs	674	1,741	2,349	3,618
Recoveries of loans previously charged off [Abstract]
Total recoveries	9	26	11	27
Florida [Member] | Installment [Member]
Loans charged off [Abstract]
Total loan chargeoffs	0	0	0	1
Recoveries of loans previously charged off [Abstract]
Total recoveries	0	0	0	1
Loans [Abstract]
Total ending loans balance	$ 62		$ 62		$ 73