Fair Value Measurements (Details 2) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2013	Dec. 31, 2012
Carrying value of assets
Impaired loans	$ 393,677	$ 346,906
MSR, net	10,177	6,947
REO, net	21,745	28,523
Carrying Value
Carrying value of assets
Loans held-for-sale, net	29,283	76,306
MSR, net	10,177	6,947
Level 3
Carrying value of assets
Loans held-for-sale, net	29,283	78,486
MSR, net	10,180	6,948
Measured on a non-recurring basis | Level 3 | Carrying Value
Carrying value of assets
Impaired loans	279,405	282,723
MSR, net	10,177	6,947
REO, net	12,108	20,796
Total	305,245	314,347
Measured on a non-recurring basis | Level 3 | Carrying Value | Non-performing loans held-for-sale, net
Carrying value of assets
Loans held-for-sale, net	$ 3,555	$ 3,881