Income Taxes - Components of Net Deferred Tax Asset (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Deferred tax assets:
Pre-opening expenses	$ 122	$ 154
Allowance for loan losses	5,883	5,545
Stock-based compensation	1,346	1,419
Off balance sheet reserve	258	217
Operating loss carryforwards	1,253	1,688
Other real estate owned	37	10
Unrealized loss on AFS securities		600
Mark to market on held for sale mortgage loans	359	2,451
Other	1,594	1,220
Deferred tax assets	10,852	13,304
Deferred tax liabilities:
Depreciation	(282)	(521)
Unrealized gain on AFS securities	(106)
Acquisition accounting fair value adjustments	(2,671)	(2,067)
Mortgage servicing rights	(3,745)	(3,586)
Other	(1,722)	(2,488)
Deferred tax liabilities	(8,526)	(8,662)
Net deferred tax assets	$ 2,326	$ 4,642