Cash Flows - Narrative (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Cash Flow [Line Items]
Transferred to foreclosed property	$ 1,170	$ 3,020	$ 4,150
Unsettled sales of government guaranteed loans	8,190	32,900	27,500
Assets acquired, fair value	265,000	481,000	1,120,000
Liabilities assumed, fair value	213,000	350,000	1,000,000
Net assets acquired	$ 52,100	130,000	115,000
Common Stock
Cash Flow [Line Items]
Common stock issued as consideration		$ 45,700	$ 179,000