Servicing Assets and Liabilities - Changes in SBA/USDA loans servicing rights (Details) - SBA/USDA - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Servicing Asset at Fair Value, Amount [Roll Forward]
Servicing rights, beginning of period	$ 7,510	$ 7,740	$ 5,752
Additions:
Acquired servicing rights	0		419
Acquired servicing rights		(354)
Originated servicing rights capitalized upon sale of loans	1,835	2,573	2,737
Subtractions:
Disposals	(1,258)	(810)	(621)
Changes in fair value:
Due to change in valuation inputs or assumptions used in the valuation model	(1,293)	(1,639)	(547)
Servicing rights, end of period	$ 6,794	$ 7,510	$ 7,740