Fair Value Measurements (Details 2) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2013	Dec. 31, 2012
Carrying value of assets
Impaired loans	$ 386,040	$ 346,906
MSR, net	10,835	6,947
REO, net	34,983	28,523
Carrying Value
Carrying value of assets
Loans held-for-sale, net	10,485	76,306
MSR, net	10,835	6,947
Level 3
Carrying value of assets
Loans held-for-sale, net	10,866	78,486
MSR, net	10,838	6,948
Measured on a non-recurring basis | Level 3 | Carrying Value
Carrying value of assets
Impaired loans	265,698	282,723
MSR, net	10,835	6,947
REO, net	20,903	20,796
Total	298,320	314,347
Measured on a non-recurring basis | Level 3 | Carrying Value | Non-performing loans held-for-sale, net
Carrying value of assets
Loans held-for-sale, net	$ 884	$ 3,881