Fair Value Measurements (Details 2) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Dec. 31, 2013
Carrying value of assets
Non-performing residential mortgage loans held-for-sale	$ 186,312
Impaired loans	251,074	384,522
MSR, net	11,804	12,800
REO, net	44,144	42,636
Carrying Value
Carrying value of assets
Loans held-for-sale, net	7,204	7,375
Non-performing residential mortgage loans held-for-sale	186,312
MSR, net	11,804	12,800
Level 3
Carrying value of assets
Loans held-for-sale, net	7,309	7,436
Non-performing residential mortgage loans held-for-sale	186,312
MSR, net	11,809	12,804
Measured on a non-recurring basis | Level 3 | Carrying Value
Carrying value of assets
Loans held-for-sale, net	958	791
Non-performing residential mortgage loans held-for-sale	186,312
Impaired loans	138,637	271,408
MSR, net	11,804	12,800
REO, net	22,309	27,101
Total	$ 360,020	$ 312,100