Fair Value Measurements - Schedule of Information Regarding Gains (Losses) Recognized on Assets (Details) - Non-recurring basis - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Gains (losses) recognized on assets	$ (7,383)	$ (4,985)	$ (7,905)
Non-performing loans held-for-sale, net
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Gains (losses) recognized on assets	0	(445)	0
Impaired loans
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Gains (losses) recognized on assets	(6,513)	(4,284)	(6,311)
MSR, net
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Gains (losses) recognized on assets	(25)	568	60
REO, net
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Gains (losses) recognized on assets	$ (845)	$ (824)	$ (1,654)