Fair Value Measurements (Details 2) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013
Carrying value of assets
Impaired loans	$ 250,749	$ 384,522
MSR, net	11,905	12,800
REO, net	42,458	42,636
Carrying value
Carrying value of assets
Loans held-for-sale, net	7,629	7,375
MSR, net	11,905	12,800
Level 3
Carrying value of assets
Loans held-for-sale, net	7,849	7,436
MSR, net	11,909	12,804
Measured on a non-recurring basis | Level 3 | Carrying value
Carrying value of assets
Loans held-for-sale, net	154	791
Impaired loans	144,258	271,408
MSR, net	11,905	12,800
REO, net	19,971	27,101
Total	$ 176,288	$ 312,100