Fair Value Measurements - Schedule of Assets And Liabilities Measured At Fair Value On A Recurring Basis (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Mar. 31, 2020	Dec. 31, 2019	Jun. 30, 2019	Mar. 31, 2019	Dec. 31, 2018
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	$ 202,347		$ 276,138
Total marketable equity securities	7,758		7,945
Servicing rights	10,721		11,920
Total other assets	24,947		16,894
Total other liabilities	11,440		3,555
Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	8,411		2,950
Total other liabilities	10,812		3,484
Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	4,653		810
U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	140,003		211,852
Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	2,327		3,297
Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	32,043		35,066
Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	27,974		25,923
Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	7,758		7,945
Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	10,721	$ 11,653	11,920	$ 10,836	$ 11,254	$ 10,821
Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	1,162		1,214
Quoted Prices in Active Markets for Identical Assets (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	79,875		75,456
Total marketable equity securities	7,758		7,945
Total other assets	0		0
Total other liabilities	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	0		0
Total other liabilities	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	47,832		57,480
Quoted Prices in Active Markets for Identical Assets (Level 1) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	32,043		17,976
Quoted Prices in Active Markets for Identical Assets (Level 1) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	7,758		7,945
Quoted Prices in Active Markets for Identical Assets (Level 1) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0		0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0		0
Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	122,472		200,682
Total marketable equity securities	0		0
Total other assets	8,411		2,950
Total other liabilities	11,440		3,555
Significant Other Observable Inputs (Level 2) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	8,411		2,950
Total other liabilities	10,812		3,484
Significant Other Observable Inputs (Level 2) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	0		0
Significant Other Observable Inputs (Level 2) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	92,171		154,372
Significant Other Observable Inputs (Level 2) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	2,327		3,297
Significant Other Observable Inputs (Level 2) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		17,090
Significant Other Observable Inputs (Level 2) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	27,974		25,923
Significant Other Observable Inputs (Level 2) | Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	0		0
Significant Other Observable Inputs (Level 2) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0		0
Significant Other Observable Inputs (Level 2) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	0		0
Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Total marketable equity securities	0		0
Total other assets	16,536		13,944
Total other liabilities	0		0
Significant Unobservable Inputs (Level 3) | Interest rate swaps
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	0		0
Total other liabilities	0		0
Significant Unobservable Inputs (Level 3) | Interest rate lock commitments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative contracts	4,653		810
Significant Unobservable Inputs (Level 3) | U.S. Treasury and government sponsored entities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Significant Unobservable Inputs (Level 3) | Municipal securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Significant Unobservable Inputs (Level 3) | Corporate bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Significant Unobservable Inputs (Level 3) | Collateralized loan obligations
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total available for sale securities	0		0
Significant Unobservable Inputs (Level 3) | Marketable equity securities
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total marketable equity securities	0		0
Significant Unobservable Inputs (Level 3) | Mortgage servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	10,721		11,920
Significant Unobservable Inputs (Level 3) | Commercial servicing rights
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Servicing rights	$ 1,162		$ 1,214