Fair Value Measurements - Schedule of Assets And Liabilities Measured At Fair Value On A Recurring Basis (Details) - USD ($) $ in Thousands	Mar. 31, 2021	Dec. 31, 2020	Mar. 31, 2020	Dec. 31, 2019
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	$ 303,810	$ 247,633
Total marketable equity securities	9,471	9,052
Total held to maturity securities	19,906	10,000
Total other assets	22,255	23,949
Total other liabilities	6,445	10,002
Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	5,970	7,387
Derivative liabilities	6,445	9,122
Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	2,713	4,034
Retail interest rate contracts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	588
Derivative liabilities		880
U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	224,493	174,601
Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	856	856
Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	30,456	30,492
Total held to maturity securities	19,906	10,000
Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	48,005	41,684
Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	9,471	9,052
Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	11,657	11,218	$ 11,653	$ 11,920
Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	1,327	1,310
Quoted Prices in Active Markets for Identical Assets (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	93,802	58,865
Total marketable equity securities	9,471	9,052
Total held to maturity securities	0	0
Total other assets	0	0
Total other liabilities	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	0	0
Derivative liabilities	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Retail interest rate contracts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	0
Derivative liabilities		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	77,184	37,548
Quoted Prices in Active Markets for Identical Assets (Level 1) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	16,618	21,317
Total held to maturity securities	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	9,471	9,052
Quoted Prices in Active Markets for Identical Assets (Level 1) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0	0
Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	210,008	188,768
Total marketable equity securities	0	0
Total held to maturity securities	0	0
Total other assets	6,558	7,387
Total other liabilities	6,445	10,002
Significant Other Observable Inputs (Level 2) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	5,970	7,387
Derivative liabilities	6,445	9,122
Significant Other Observable Inputs (Level 2) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	0	0
Significant Other Observable Inputs (Level 2) | Retail interest rate contracts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	588
Derivative liabilities		880
Significant Other Observable Inputs (Level 2) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	147,309	137,053
Significant Other Observable Inputs (Level 2) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	856	856
Significant Other Observable Inputs (Level 2) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	13,838	9,175
Total held to maturity securities	0	0
Significant Other Observable Inputs (Level 2) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	48,005	41,684
Significant Other Observable Inputs (Level 2) | Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	0	0
Significant Other Observable Inputs (Level 2) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0	0
Significant Other Observable Inputs (Level 2) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0	0
Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Total marketable equity securities	0	0
Total held to maturity securities	19,906	10,000
Total other assets	15,697	16,562
Total other liabilities	0	0
Significant Unobservable Inputs (Level 3) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	0	0
Derivative liabilities	0	0
Significant Unobservable Inputs (Level 3) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	2,713	4,034
Significant Unobservable Inputs (Level 3) | Retail interest rate contracts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	0
Derivative liabilities		0
Significant Unobservable Inputs (Level 3) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Significant Unobservable Inputs (Level 3) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Significant Unobservable Inputs (Level 3) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Total held to maturity securities	19,906	10,000
Significant Unobservable Inputs (Level 3) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Significant Unobservable Inputs (Level 3) | Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	0	0
Significant Unobservable Inputs (Level 3) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	11,657	11,218
Significant Unobservable Inputs (Level 3) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	$ 1,327	$ 1,310