Fair Value of Financial Instruments - Fair Value Hierarchy (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Dec. 31, 2019
Total available-for-sale securities	$ 589,017	$ 540,852
Servicing asset	2,522	2,481
Loans held-for-sale (mandatory pricing agreements)	38,813	56,097
Derivative, fair value	(34,511)	(37,939)
Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	2,001	56,097
Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Servicing asset	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	0	0
Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	589,017	540,852
Servicing asset	0	0
Significant Other Observable Inputs (Level 2) | Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	2,001	56,097
Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Servicing asset	2,522	2,481
Significant Unobservable Inputs (Level 3) | Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	0	0
U.S. Government-sponsored agencies
Total available-for-sale securities	66,544	75,872
U.S. Government-sponsored agencies | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
U.S. Government-sponsored agencies | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	66,544	75,872
U.S. Government-sponsored agencies | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Municipal securities
Total available-for-sale securities	90,562	97,652
Municipal securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Municipal securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	90,562	97,652
Municipal securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Agency mortgage-backed securities
Total available-for-sale securities	278,530	261,440
Agency mortgage-backed securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Agency mortgage-backed securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities		261,440
Agency mortgage-backed securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Private label mortgage-backed securities
Total available-for-sale securities	101,925	63,613
Private label mortgage-backed securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities		0
Private label mortgage-backed securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Asset-backed securities
Total available-for-sale securities	4,837	4,955
Asset-backed securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Asset-backed securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	4,837	4,955
Asset-backed securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Corporate securities
Total available-for-sale securities	46,619	37,320
Corporate securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Corporate securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	46,619	37,320
Corporate securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
IRLCs
Derivative, fair value	282	910
IRLCs | Quoted Prices in Active Markets for Identical Assets (Level 1)
Derivative, fair value	0	0
IRLCs | Significant Other Observable Inputs (Level 2)
Derivative, fair value	0	0
IRLCs | Significant Unobservable Inputs (Level 3)
Derivative, fair value	282	910
Interest rate swaps | Interest rate swaps
Derivative liability, fair value	(34,494)	(37,786)
Interest rate swaps | Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate swaps
Derivative liability, fair value	0	0
Interest rate swaps | Significant Other Observable Inputs (Level 2) | Interest rate swaps
Derivative liability, fair value	(34,494)	(37,786)
Interest rate swaps | Significant Unobservable Inputs (Level 3) | Interest rate swaps
Derivative liability, fair value	0	0
Forward contracts | Forward contracts
Derivative, fair value	(17)	(153)
Forward contracts | Quoted Prices in Active Markets for Identical Assets (Level 1) | Forward contracts
Derivative, fair value	(17)	(153)
Forward contracts | Significant Other Observable Inputs (Level 2) | Forward contracts
Derivative, fair value	0	0
Forward contracts | Significant Unobservable Inputs (Level 3) | Forward contracts
Derivative, fair value	$ 0	$ 0