Income Taxes - Schedule of Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Deferred tax assets:
Allowance for loan losses	$ 4,605	$ 4,476
SERP	1,006	790
Stock-based compensation	719	561
Deferred compensation	533	385
Net unrealized security losses	0	292
Depreciation	159	231
State net operating loss	140	214
EVP retirement plan	133	130
Commitment reserve	77	84
Other	212	238
Gross deferred tax assets	7,584	7,401
Valuation allowance	(140)	(214)
Total deferred tax assets	7,444	7,187
Deferred tax liabilities:
Deferred loan costs	451	414
Goodwill	400	382
Prepaid insurance	354	324
Deferred servicing fees	311	243
Net unrealized security gains	111	0
Bond accretion	73	72
Interest rate swaps	69	402
Other	116	0
Total deferred tax liabilities	1,885	1,837
Net deferred tax asset	$ 5,559	$ 5,350