Fair Value Measurements - Schedule of Assets And Liabilities Measured At Fair Value On A Recurring Basis (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Jun. 30, 2020	Dec. 31, 2019	Sep. 30, 2019	Jun. 30, 2019	Dec. 31, 2018
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	$ 215,369		$ 276,138
Total marketable equity securities	8,534		7,945
Servicing rights	10,589		11,920
Total other assets	27,240		16,894
Total other liabilities	11,468		3,555
Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	8,846		2,950
Derivative liabilities	11,002		3,484
Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	6,519		810
U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	157,552		211,852
Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	2,336		3,297
Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	27,215		35,066
Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	28,266		25,923
Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	8,534		7,945
Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	10,589	$ 10,721	11,920	$ 11,206	$ 10,836	$ 10,821
Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	1,286		1,214
Quoted Prices in Active Markets for Identical Assets (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	59,865		75,456
Total marketable equity securities	8,534		7,945
Total other assets	0		0
Total other liabilities	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	0		0
Derivative liabilities	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	37,691		57,480
Quoted Prices in Active Markets for Identical Assets (Level 1) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	22,174		17,976
Quoted Prices in Active Markets for Identical Assets (Level 1) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	8,534		7,945
Quoted Prices in Active Markets for Identical Assets (Level 1) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0		0
Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	155,504		200,682
Total marketable equity securities	0		0
Total other assets	8,846		2,950
Total other liabilities	11,468		3,555
Significant Other Observable Inputs (Level 2) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	8,846		2,950
Derivative liabilities	11,002		3,484
Significant Other Observable Inputs (Level 2) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	0		0
Significant Other Observable Inputs (Level 2) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	119,861		154,372
Significant Other Observable Inputs (Level 2) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	2,336		3,297
Significant Other Observable Inputs (Level 2) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	5,041		17,090
Significant Other Observable Inputs (Level 2) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	28,266		25,923
Significant Other Observable Inputs (Level 2) | Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	0		0
Significant Other Observable Inputs (Level 2) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0		0
Significant Other Observable Inputs (Level 2) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0		0
Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Total marketable equity securities	0		0
Total other assets	18,394		13,944
Total other liabilities	0		0
Significant Unobservable Inputs (Level 3) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	0		0
Derivative liabilities	0		0
Significant Unobservable Inputs (Level 3) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative assets	6,519		810
Significant Unobservable Inputs (Level 3) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Significant Unobservable Inputs (Level 3) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Significant Unobservable Inputs (Level 3) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Significant Unobservable Inputs (Level 3) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Significant Unobservable Inputs (Level 3) | Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	0		0
Significant Unobservable Inputs (Level 3) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	10,589		11,920
Significant Unobservable Inputs (Level 3) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	$ 1,286		$ 1,214