Fair Value of Financial Instruments - Schedule of Fair Value Hierarchy Level and Estimated Fair Value of Significant Financial Instruments (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Financial Assets:
Investment securities - AFS	$ 126,069	$ 73,762
Investment securities - HTM	8,632	9,940
Carrying Value
Financial Assets:
Cash and due from banks	114,763	147,685
Federal funds sold and other cash equivalents	67,000
Interest-earning deposits in other financial institutions	600	600
Investment securities - AFS	126,069	73,762
Investment securities - HTM	8,332	9,961
Mortgage loans held for sale	108,194	434,522
Loans, net	2,178,118	2,124,438
Equity securities	11,826	10,039
Mortgage servicing rights	17,083	17,370
Financial Liabilities:
Deposits	2,248,938	2,144,041
FHLB advances		319,500
Long-term debt	104,049	103,708
Subordinated debenture liability	9,673	9,506
Fair Value | Fair Value, Inputs, Level 1
Financial Assets:
Cash and due from banks	114,763	147,685
Federal funds sold and other cash equivalents	67,000
Interest-earning deposits in other financial institutions	600	600
Mortgage loans held for sale	109,385	438,948
Fair Value | Fair Value Measurements Using Level 2
Financial Assets:
Investment securities - AFS	126,069	73,762
Investment securities - HTM	8,632	9,940
Mortgage servicing rights	20,752	21,361
Financial Liabilities:
Deposits	2,236,329	2,143,196
FHLB advances		319,500
Long-term debt	109,877	79,756
Fair Value | Fair Value Measurements Using Level 3
Financial Assets:
Loans, net	2,158,970	2,114,341
Equity securities	11,826	10,039
Financial Liabilities:
Subordinated debenture liability	$ 11,709	$ 10,356