Fair Value - Measured on Recurring Basis (Details) (USD $) In Thousands, unless otherwise specified	9 Months Ended
	Sep. 30, 2013	Sep. 30, 2012	Dec. 31, 2012
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	$ 1,498,377		$ 1,513,157
Loans held for sale	190,635		465,983
Loans receivable, net	26,931		23,177
Contingent consideration		14,051
Loans receivable, at fair value [Roll Forward]
Beginning balance	23,177	12,776
Transfers from held for sale	15,622	12,308
Principal payments received	(11,078)	(2,245)
Valuation adjustments	(790)	(379)
Ending balance	26,931	22,460
Fair Value Option, Differences Between Fair Values and Contractual Cash Flows	790	379
Contingent Consideration Liability [Roll Forward]
Beginnning balance	15,442	0
Additions	0	11,779
Valuation adjustments	1,395	2,272
Payout	(16,837)	0
Ending balance		14,051
Mortgage banking operations	190,635		465,983
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0		0
Loans held for sale	0		0
Loans receivable, net	26,931		23,177
Other assets - derivatives	0		0
Total assets	26,931		23,177
Contingent consideration	0		15,442
Other liabilities - derivatives	0		0
Total liabilities	0		15,442
Contingent Consideration Liability [Roll Forward]
Beginnning balance			15,442
Ending balance	0		15,442
Mortgage banking operations	0		0
Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value, Fair Value Disclosure [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	1,498,377		1,513,157
Loans held for sale	190,635		465,983
Loans receivable, net	26,931		23,177
Other assets - derivatives	7,443		11,183
Total assets	1,723,386		2,013,500
Contingent consideration			15,442
Other liabilities - derivatives	6,236		4,025
Total liabilities	6,236		19,467
Contingent Consideration Liability [Roll Forward]
Beginnning balance			15,442
Ending balance			15,442
Mortgage banking operations	190,635		465,983
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0		0
Loans held for sale	0		0
Loans receivable, net	0		0
Other assets - derivatives	0		0
Total assets	0		0
Contingent consideration			0
Other liabilities - derivatives	0		0
Total liabilities	0		0
Contingent Consideration Liability [Roll Forward]
Beginnning balance			0
Ending balance			0
Mortgage banking operations	0		0
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	1,498,377		1,513,157
Loans held for sale	190,635		465,983
Loans receivable, net	0		0
Other assets - derivatives	7,443		11,183
Total assets	1,696,455		1,990,323
Contingent consideration			0
Other liabilities - derivatives	6,236		4,025
Total liabilities	6,236		4,025
Contingent Consideration Liability [Roll Forward]
Beginnning balance			0
Ending balance			0
Mortgage banking operations	190,635		465,983
MBS
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	1,305,456		1,308,838
MBS | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0		0
MBS | Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value, Fair Value Disclosure [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	1,305,456		1,308,838
MBS | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	0		0
MBS | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Available for sale	$ 1,305,456		$ 1,308,838