Income Taxes - Deferred Assets and Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Deferred Tax Assets
Net operating loss carryforward	$ 864	$ 1,201
Allowance for loan losses	2,844	2,301
Purchase accounting adjustments	466	776
Other real estate owned	126	127
Non-accrued loan interest	13	115
Restricted stock awards	68	54
Non-qualified stock options	185	71
Securities available-for-sale	0	405
Lease liability	1,121	0
Other	351	473
Total deferred tax assets	6,038	5,523
Deferred Tax Liabilities
Loan origination costs	(1,341)	(626)
Servicing rights	(2,525)	(2,241)
Prepaids	0	(166)
Stock dividend - FHLB stock	(59)	(73)
Property, plant, and equipment	(1,362)	(1,489)
Purchase accounting adjustments	(1,404)	(1,289)
Securities available-for-sale	(216)	0
Lease right-of-use assets	(1,078)	0
Other	(24)	0
Total deferred tax liabilities	(8,009)	(5,884)
Net deferred tax liabilities	$ (1,971)	$ (361)