Fair Value Measurements (Details 3) (Measured on a non-recurring basis, USD $) In Thousands, unless otherwise specified	6 Months Ended
	Jun. 30, 2014	Jun. 30, 2013
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	$ 13,037	$ 15,484
Non-performing loans held-for-sale, net
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	150	858
Non-performing residential mortgage loans held-for-sale
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	8,656
Impaired loans
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	2,220	13,449
MSR, net
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	123
REO, net
Fair Value of Financial Instruments
Losses recognized on assets measured at fair value on a non-recurring basis	$ 1,888	$ 1,177