Fair Value Measurements (Carrying Values of Assets Measured at Fair Value on a Non-Recurring Basis) (Details) - USD ($) $ in Thousands	Jun. 30, 2016	Dec. 31, 2015
Carrying Value
Impaired loans	$ 229,459	$ 237,518
MSR, net	8,881	11,014
REO, net	14,940	19,798
Carrying Value
Carrying Value
Non-performing loans held-for-sale, net	6,843	8,960
MSR, net	8,881	11,014
Measured on a non-recurring basis | Level 3 | Carrying Value
Carrying Value
Non-performing loans held-for-sale, net	673	1,582
Impaired loans	126,192	134,910
MSR, net	8,881	11,014
REO, net	12,434	16,307
Total	$ 148,180	$ 163,813