Fair Value Measurements - Schedule of Estimated Fair Values (Details) - USD ($) $ in Thousands	Mar. 31, 2021	Dec. 31, 2020	Mar. 31, 2020	Dec. 31, 2019
Financial assets:
Investment securities available for sale, at fair value	$ 303,810	$ 247,633
Marketable equity securities	9,471	9,052
Investment securities held to maturity	19,906	10,000
Purchased receivables, net	11,818	13,922
Mortgage servicing rights
Financial assets:
Servicing rights	11,657	11,218	$ 11,653	$ 11,920
Commercial servicing rights
Financial assets:
Servicing rights	1,327	1,310
Interest rate swaps
Financial assets:
Derivative assets	5,970	7,387
Financial liabilities:
Derivative liabilities	6,445	9,122
Interest rate lock commitments
Financial assets:
Derivative assets	2,713	4,034
Retail interest rate contracts
Financial assets:
Derivative assets	588
Financial liabilities:
Derivative liabilities		880
Level 1 inputs:
Financial assets:
Investment securities available for sale, at fair value	93,802	58,865
Marketable equity securities	9,471	9,052
Investment securities held to maturity	0	0
Level 1 inputs: | Mortgage servicing rights
Financial assets:
Servicing rights	0	0
Level 1 inputs: | Commercial servicing rights
Financial assets:
Servicing rights	0	0
Level 1 inputs: | Interest rate swaps
Financial assets:
Derivative assets	0	0
Financial liabilities:
Derivative liabilities	0	0
Level 1 inputs: | Interest rate lock commitments
Financial assets:
Derivative assets	0	0
Level 1 inputs: | Retail interest rate contracts
Financial assets:
Derivative assets	0
Financial liabilities:
Derivative liabilities		0
Level 1 inputs: | Carrying Amount
Financial assets:
Cash, due from banks and deposits in other banks	203,590	115,965
Investment securities available for sale, at fair value	93,802	58,865
Marketable equity securities	9,471	9,052
Level 1 inputs: | Fair Value
Financial assets:
Cash, due from banks and deposits in other banks	203,590	115,965
Investment securities available for sale, at fair value	93,802	58,865
Marketable equity securities	9,471	9,052
Level 2 inputs:
Financial assets:
Investment securities available for sale, at fair value	210,008	188,768
Marketable equity securities	0	0
Investment securities held to maturity	0	0
Level 2 inputs: | Mortgage servicing rights
Financial assets:
Servicing rights	0	0
Level 2 inputs: | Commercial servicing rights
Financial assets:
Servicing rights	0	0
Level 2 inputs: | Interest rate swaps
Financial assets:
Derivative assets	5,970	7,387
Financial liabilities:
Derivative liabilities	6,445	9,122
Level 2 inputs: | Interest rate lock commitments
Financial assets:
Derivative assets	0	0
Level 2 inputs: | Retail interest rate contracts
Financial assets:
Derivative assets	588
Financial liabilities:
Derivative liabilities		880
Level 2 inputs: | Carrying Amount
Financial assets:
Investment securities available for sale, at fair value	210,008	188,768
Investment in Federal Home Loan Bank stock	3,116	2,551
Loans held for sale	116,128	146,178
Accrued interest receivable	8,243	7,979
Financial liabilities:
Deposits	2,051,317	1,824,981
Borrowings	14,749	14,817
Accrued interest payable	67	65
Level 2 inputs: | Carrying Amount | Interest rate swaps
Financial assets:
Derivative assets	5,970	7,387
Financial liabilities:
Derivative liabilities	6,445	9,122
Level 2 inputs: | Carrying Amount | Retail interest rate contracts
Financial assets:
Derivative assets	588	0
Financial liabilities:
Derivative liabilities	0	880
Level 2 inputs: | Fair Value
Financial assets:
Investment securities available for sale, at fair value	210,008	188,768
Investment in Federal Home Loan Bank stock	3,116	2,551
Loans held for sale	116,128	146,178
Accrued interest receivable	8,243	7,979
Financial liabilities:
Deposits	2,052,781	1,826,990
Borrowings	15,133	15,538
Accrued interest payable	67	65
Level 2 inputs: | Fair Value | Interest rate swaps
Financial assets:
Derivative assets	5,970	7,387
Financial liabilities:
Derivative liabilities	6,445	9,122
Level 2 inputs: | Fair Value | Retail interest rate contracts
Financial assets:
Derivative assets	588	0
Financial liabilities:
Derivative liabilities	0	880
Level 3 inputs:
Financial assets:
Investment securities available for sale, at fair value	0	0
Marketable equity securities	0	0
Investment securities held to maturity	19,906	10,000
Level 3 inputs: | Mortgage servicing rights
Financial assets:
Servicing rights	11,657	11,218
Level 3 inputs: | Commercial servicing rights
Financial assets:
Servicing rights	1,327	1,310
Level 3 inputs: | Interest rate swaps
Financial assets:
Derivative assets	0	0
Financial liabilities:
Derivative liabilities	0	0
Level 3 inputs: | Interest rate lock commitments
Financial assets:
Derivative assets	2,713	4,034
Level 3 inputs: | Retail interest rate contracts
Financial assets:
Derivative assets	0
Financial liabilities:
Derivative liabilities		0
Level 3 inputs: | Carrying Amount
Financial assets:
Investment securities held to maturity	20,000	10,000
Loans	1,548,924	1,444,051
Purchased receivables, net	11,818	13,922
Financial liabilities:
Junior subordinated debentures	10,310	10,310
Level 3 inputs: | Carrying Amount | Mortgage servicing rights
Financial assets:
Servicing rights	11,657	11,218
Level 3 inputs: | Carrying Amount | Commercial servicing rights
Financial assets:
Servicing rights	1,327	1,310
Level 3 inputs: | Carrying Amount | Interest rate lock commitments
Financial assets:
Derivative assets	2,713	4,034
Level 3 inputs: | Fair Value
Financial assets:
Investment securities held to maturity	19,906	10,000
Loans	1,513,712	1,414,179
Purchased receivables, net	11,818	13,922
Financial liabilities:
Junior subordinated debentures	9,869	10,475
Level 3 inputs: | Fair Value | Mortgage servicing rights
Financial assets:
Servicing rights	11,657	11,218
Level 3 inputs: | Fair Value | Commercial servicing rights
Financial assets:
Servicing rights	1,327	1,310
Level 3 inputs: | Fair Value | Interest rate lock commitments
Financial assets:
Derivative assets	$ 2,713	$ 4,034