Fair Value - Measured on a Non-recurring Basis (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Loans receivable, net	$ 26,462	$ 23,177
Gain (loss) on OREO	(2,418)	(247)	(16,628)
Gain (loss) on mortgage servicing rights	6,948	(216)	(6,179)
Charge-offs on properties held	884	3,900
Loans [Member] | Fair Value, Measurements, Nonrecurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Gain (loss) on loans	(15,352)	(27,649)
Loans [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Loans receivable, net	118,037	172,172
Loans [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Loans receivable, net	0	0
Loans [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Loans receivable, net	0	0
Other Real Estate Owned [Member] | Fair Value, Measurements, Nonrecurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Gain (loss) on OREO	(930)	(1,296)
Other Real Estate Owned [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
OREO	522	18,074
Other Real Estate Owned [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
OREO	0	0
Other Real Estate Owned [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
OREO	0	0
Mortgage Servicing Rights [Member] | Fair Value, Measurements, Nonrecurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Gain (loss) on mortgage servicing rights	6,948	(230)
Mortgage Servicing Rights [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage servicing rights, at fair value	60,100	32,420
Mortgage Servicing Rights [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage servicing rights, at fair value	0	0
Mortgage Servicing Rights [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage servicing rights, at fair value	0	0
Reported Value Measurement [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Loans receivable, net	7,331,228	6,101,749
Reported Value Measurement [Member] | Loans [Member] | Fair Value, Measurements, Nonrecurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Loans receivable, net	118,037	172,172
Reported Value Measurement [Member] | Other Real Estate Owned [Member] | Fair Value, Measurements, Nonrecurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
OREO	522	18,074
Reported Value Measurement [Member] | Mortgage Servicing Rights [Member] | Fair Value, Measurements, Nonrecurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage servicing rights, at fair value	$ 60,100	$ 32,420
Residential real estate [Member] | Mortgage Servicing Rights [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Weighted average prepayment speed	9.30%
Weighted average discount rate	10.20%
Commercial real estate | Mortgage Servicing Rights [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Weighted average prepayment speed	11.70%
Weighted average discount rate	15.70%
Minimum | Loans [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Fair value inputs, selling costs, percent	4.50%
Minimum | Other Real Estate Owned [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Fair value inputs, selling costs, percent	4.50%
Maximum | Loans [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Fair value inputs, selling costs, percent	9.00%
Maximum | Other Real Estate Owned [Member] | Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Fair value inputs, selling costs, percent	9.00%