Fair Value Measurements - Schedule of Assets And Liabilities Measured At Fair Value On A Recurring Basis (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019	Mar. 31, 2019	Dec. 31, 2018
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	$ 268,959	$ 276,138
Total marketable equity securities	7,609	7,945
Servicing rights	11,653	11,920
Total other assets	24,069	16,894
Total other liabilities	13,189	3,555
Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	8,028	2,950
Total other liabilities	10,429	3,484
Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	3,188	810
U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	211,909	211,852
Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	2,323	3,297
Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	30,567	35,066
Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	24,160	25,923
Equity Securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	7,609	7,945
Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	11,653	11,920	$ 11,254	$ 10,821
Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	1,200	1,214
Quoted Prices in Active Markets for Identical Assets (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	77,085	75,456
Total marketable equity securities	7,609	7,945
Total other assets	0	0
Total other liabilities	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	0	0
Total other liabilities	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	58,097	57,480
Quoted Prices in Active Markets for Identical Assets (Level 1) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	18,988	17,976
Quoted Prices in Active Markets for Identical Assets (Level 1) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Equity Securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	7,609	7,945
Quoted Prices in Active Markets for Identical Assets (Level 1) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0	0
Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	191,874	200,682
Total marketable equity securities	0	0
Total other assets	8,028	2,950
Total other liabilities	13,189	3,555
Significant Other Observable Inputs (Level 2) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	8,028	2,950
Total other liabilities	10,429	3,484
Significant Other Observable Inputs (Level 2) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	0	0
Significant Other Observable Inputs (Level 2) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	153,812	154,372
Significant Other Observable Inputs (Level 2) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	2,323	3,297
Significant Other Observable Inputs (Level 2) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	11,579	17,090
Significant Other Observable Inputs (Level 2) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	24,160	25,923
Significant Other Observable Inputs (Level 2) | Equity Securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	0	0
Significant Other Observable Inputs (Level 2) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0	0
Significant Other Observable Inputs (Level 2) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0	0
Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Total marketable equity securities	0	0
Total other assets	16,041	13,944
Total other liabilities	0	0
Significant Unobservable Inputs (Level 3) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	0	0
Total other liabilities	0	0
Significant Unobservable Inputs (Level 3) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	3,188	810
Significant Unobservable Inputs (Level 3) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Significant Unobservable Inputs (Level 3) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Significant Unobservable Inputs (Level 3) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Significant Unobservable Inputs (Level 3) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0	0
Significant Unobservable Inputs (Level 3) | Equity Securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	0	0
Significant Unobservable Inputs (Level 3) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	11,653	11,920
Significant Unobservable Inputs (Level 3) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	$ 1,200	$ 1,214