Fair Value of Financial Instruments - Fair Value Hierarchy (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Total available-for-sale securities	$ 608,682	$ 540,852
Servicing asset	2,415	2,481
Loans held-for-sale (mandatory pricing agreements)	52,394	56,097
Derivative, fair value	(80,850)	(37,939)
Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	52,394	56,097
Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Servicing asset	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) | Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	0	0
Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	608,682	540,852
Servicing asset	0	0
Significant Other Observable Inputs (Level 2) | Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	52,394	56,097
Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Servicing asset	2,415	2,481
Significant Unobservable Inputs (Level 3) | Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	0	0
U.S. Government-sponsored agencies
Total available-for-sale securities	70,004	75,872
U.S. Government-sponsored agencies | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
U.S. Government-sponsored agencies | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	70,004	75,872
U.S. Government-sponsored agencies | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Municipal securities
Total available-for-sale securities	94,819	97,652
Municipal securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Municipal securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	94,819	97,652
Municipal securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Agency mortgage-backed securities
Total available-for-sale securities	282,632	261,440
Agency mortgage-backed securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Agency mortgage-backed securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities		261,440
Agency mortgage-backed securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Private label mortgage-backed securities
Total available-for-sale securities	115,024	63,613
Private label mortgage-backed securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities		0
Private label mortgage-backed securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Asset-backed securities
Total available-for-sale securities	4,713	4,955
Asset-backed securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Asset-backed securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	4,713	4,955
Asset-backed securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
Corporate securities
Total available-for-sale securities	41,490	37,320
Corporate securities | Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available-for-sale securities	0	0
Corporate securities | Significant Other Observable Inputs (Level 2)
Total available-for-sale securities	41,490	37,320
Corporate securities | Significant Unobservable Inputs (Level 3)
Total available-for-sale securities	0	0
IRLCs
Derivative, fair value	2,064	910
IRLCs | Quoted Prices in Active Markets for Identical Assets (Level 1)
Derivative, fair value	0	0
IRLCs | Significant Other Observable Inputs (Level 2)
Derivative, fair value	0	0
IRLCs | Significant Unobservable Inputs (Level 3)
Derivative, fair value	2,064	910
Interest rate swaps | Interest rate swaps
Derivative liability, fair value	(78,552)	(37,786)
Interest rate swaps | Quoted Prices in Active Markets for Identical Assets (Level 1) | Interest rate swaps
Derivative liability, fair value	0	0
Interest rate swaps | Significant Other Observable Inputs (Level 2) | Interest rate swaps
Derivative liability, fair value	(78,552)	(37,786)
Interest rate swaps | Significant Unobservable Inputs (Level 3) | Interest rate swaps
Derivative liability, fair value	0	0
Forward contracts | Forward contracts
Derivative, fair value	(2,298)	(153)
Forward contracts | Quoted Prices in Active Markets for Identical Assets (Level 1) | Forward contracts
Derivative, fair value	(2,298)	(153)
Forward contracts | Significant Other Observable Inputs (Level 2) | Forward contracts
Derivative, fair value	0	0
Forward contracts | Significant Unobservable Inputs (Level 3) | Forward contracts
Derivative, fair value	$ 0	$ 0