Fair Value Measurements (Details 2) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Carrying value of assets
Impaired loans	$ 341,860	$ 286,387
MSR, net	6,947	8,136	9,204
REO, net	28,523	48,059
Carrying Value
Carrying value of assets
Loans held-for-sale, net	76,306	32,394
MSR, net	6,947	8,136
Level 3
Carrying value of assets
Loans held-for-sale, net	78,486	32,611
MSR, net	6,948	8,137
Measured on a non-recurring basis | Level 3 | Carrying Value
Carrying value of assets
Impaired loans	282,723	232,849
MSR, net	6,947	8,136
REO, net	20,796	36,956
Total	314,347	297,685
Measured on a non-recurring basis | Level 3 | Carrying Value | Non-performing loans held-for-sale, net
Carrying value of assets
Loans held-for-sale, net	$ 3,881	$ 19,744