Income Tax - Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Deferred tax assets
Allowance for loan losses	$ 18,613	$ 13,928
Lease incentive	322	294
Impairment of available-for-sale securities	0	493
Valuation allowance on real estate	269	0
Loan fees	3,747	2,317
Net operating loss carryover	344	339
Accrued expenses	1,485	2,131
Deferred compensation	2,776	2,444
State tax credit	2,519	3,287
Other	60	81
Total deferred tax asset	30,135	25,314
Deferred tax liability
Fair market value adjustments - trust preferred securities	(341)	(348)
Net unrealized gain on securities available-for-sale	(8,357)	(5,339)
FHLB stock basis	(1,194)	(996)
Premises and equipment	(3,150)	(3,620)
Other	(1,229)	(1,229)
Total deferred tax liability	(14,271)	(11,532)
Net deferred tax asset	$ 15,864	$ 13,782