Fair Value Measurements (Carrying Values of Assets Measured at Fair Value on a Non-Recurring Basis) (Details) - USD ($) $ in Thousands	Mar. 31, 2016	Dec. 31, 2015
Carrying value of assets
Impaired loans	$ 229,803	$ 237,518
MSR, net	9,900	11,014
REO, net	12,691	19,798
Carrying Value
Carrying value of assets
Non-performing loans held-for-sale, net	7,672	8,960
MSR, net	9,900	11,014
Measured on a non-recurring basis | Level 3 | Carrying Value
Carrying value of assets
Non-performing loans held-for-sale, net	914	1,582
Impaired loans	126,349	134,910
MSR, net	9,900	11,014
REO, net	9,758	16,307
Total	$ 146,921	$ 163,813