Fair Value Measurements - Schedule of Gains (Losses) Recognized on Assets Measured at Fair Value on a Non-Recurring Basis (Details) - Nonrecurring - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2017	Mar. 31, 2016
Fair Value of Financial Instruments
Total	$ (2,112)	$ (2,985)
Non-performing loans held-for-sale, net
Fair Value of Financial Instruments
Total	0	0
Impaired loans
Fair Value of Financial Instruments
Total	(1,704)	(1,858)
MSR, net
Fair Value of Financial Instruments
Total	215	(877)
REO, net
Fair Value of Financial Instruments
Total	$ (623)	$ (250)