Fair Value Measurements (Details 3) (Measured on a non-recurring basis, USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	$ 26,300	$ 45,152	$ 64,925
Non-performing loans held-for-sale, net
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	520	1,066	10,020
Impaired loans
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	21,992	40,018	48,080
MSR, net
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis		931	148
REO, net
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	$ 3,788	$ 3,137	$ 6,677