Fair Value - Measured on Recurring Basis (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	$ 1,429,812	$ 1,513,157
Loans receivable, net	26,462	23,177
Beginning balance	15,442	0
Loans receivable, at fair value [Roll Forward]
Beginning balance	23,177	12,776
Transfers from held for sale	16,060	14,450
Principal payments and payoffs	(11,511)	(3,515)
Valuation adjustments	(1,264)	(534)
Ending balance	26,462	23,177
Fair Value Option, Differences Between Fair Values and Contractual Cash Flows	1264	534
Contingent Consideration Liability [Roll Forward]
Beginning balance	15,442	0
Additions	0	11,700
Valuation adjustments	1,395	3,742
cash paid contingent consideration	(16,837)	0
Ending balance		15,442
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0	0
Loans held for sale	0	0
Loans receivable, net	0	0
Other assets - derivatives	0	0
Total assets	0	0
Other liabilities - derivatives	0	0
Total liabilities	0	0
Contingent Consideration Liability [Roll Forward]
Ending balance		0
Mortgage banking operations	0	0
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	1,429,812	1,513,157
Loans held for sale	138,952	465,983
Loans receivable, net	0	0
Other assets - derivatives	4,479	11,183
Total assets	1,573,243	1,990,323
Other liabilities - derivatives	516	4,025
Total liabilities	516	4,025
Contingent Consideration Liability [Roll Forward]
Ending balance		0
Mortgage banking operations	138,952	465,983
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0	0
Loans held for sale	0	0
Loans receivable, net	26,462	23,177
Other assets - derivatives	0	0
Total assets	26,462	23,177
Other liabilities - derivatives	0	0
Total liabilities	0	15,442
Contingent Consideration Liability [Roll Forward]
Ending balance	0	15,442
Mortgage banking operations	0	0
Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value Measurement [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	1,429,812	1,513,157
Loans held for sale	138,952	465,983
Loans receivable, net	26,462	23,177
Other assets - derivatives	4,479	11,183
Total assets	1,599,705	2,013,500
Other liabilities - derivatives	516
Total liabilities	516	19,467
Contingent Consideration Liability [Roll Forward]
Mortgage banking operations	138,952	465,983
MBS
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	1,239,900	1,308,838
MBS | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0	0
MBS | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	1,239,900	1,308,838
MBS | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0	0
MBS | Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value Measurement [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	1,239,900	1,308,838
Municipal Bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	189,690	204,306
Municipal Bonds | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0	0
Municipal Bonds | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	189,690	204,306
Municipal Bonds | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0	0
Municipal Bonds | Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value Measurement [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	189,690	204,306
Investment Securities, Available For Sale, Other [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0	0
Investment Securities, Available For Sale, Other [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	222	13
Investment Securities, Available For Sale, Other [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0	0
Investment Securities, Available For Sale, Other [Member] | Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value Measurement [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	222	13
Changes Measurement [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Loans held for sale	(17,299)	11,447
Contingent Consideration Liability [Roll Forward]
Mortgage banking operations	$ (17,299)	$ 11,447