Deferred Income Taxes Schedule of Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Components of Deferred Tax Assets and Liabilities [Abstract]
Deferred tax assets, allowance for loan losses	$ 4,583	$ 4,309
Deferred tax assets, net unrealized losses on interest rate swaps	6,670	1,441
Deferred tax assets, lease liabilities	2,188	2,275
Deferred tax assets, accrued expenses	179	297
Deferred tax assets, restricted stock unit compensation	417	832
Deferred tax assets, state net operating loss carryforward	1,139	1,114
Deferred tax assets, capital loss carryforward	3	3
Deferred tax assets, other	48	53
Deferred tax assets, gross	15,227	10,324
Deferred tax liabilities, right-of-use assets	2,131	2,218
Deferred tax liabilities, net deferred loan fees and costs	218	218
Deferred tax liabilities, net unrealized gains on available-for-sale securities	401	352
Deferred tax liabilities, premises and equipment	829	839
Deferred tax liabilities, other	230	219
Deferred tax liabilities, gross	3,809	3,846
Net deferred tax assets before valuation allowance	11,418	6,478
Valuation allowance	(1,142)	(1,117)
Net deferred tax assets	$ 10,276	$ 5,361