Fair Value Measurements (Details 3) (Measured on a non-recurring basis, USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2014	Dec. 31, 2013	Dec. 31, 2012
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	$ 7,965	$ 26,300	$ 45,152
Non-performing loans held-for-sale, net
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis		520	1,066
Impaired loans
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	6,311	21,992	40,018
MSR, net
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis			931
REO, net
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	$ 1,654	$ 3,788	$ 3,137