Loan Sales and Servicing - Residential MSRs (Details) - USD ($) $ in Thousands		3 Months Ended
		Mar. 31, 2020	Mar. 31, 2019
Servicing Asset at Fair Value, Amount [Roll Forward]
Beginning balance		$ 42,022
Increase (decrease) in fair value:
Ending balance		31,232
Residential Mortgage
Servicing Asset at Fair Value, Amount [Roll Forward]
Beginning balance		42,022	$ 51,539
Additions		1,671	1,059
Increase (decrease) in fair value:
Due to changes in valuation inputs or assumptions		(10,140)	(2,343)
Due to other changes in fair value	[1]	(2,321)	(2,710)
Ending balance		$ 31,232	$ 47,545

[1] Represents the realization of expected net servicing cash flows, expected borrower repayments and the passage of time.