Investment Securities - Schedule of Gross Unrealized Losses on Investment Securities (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Debt Securities, Available-for-sale [Line Items]
Less than 12 months, fair value	$ 54,769	$ 41,201
Less than 12 months, unrealized losses	(50)	(507)
More than 12 months, fair value	10,947	137,480
More than 12 months, unrealized losses	(44)	(1,455)
Total, fair value	65,716	178,681
Total, unrealized losses	(94)	(1,962)
U.S. Treasury and government sponsored entities
Debt Securities, Available-for-sale [Line Items]
Less than 12 months, fair value	39,797	5,030
Less than 12 months, unrealized losses	(33)	(6)
More than 12 months, fair value	2,996	135,807
More than 12 months, unrealized losses	(4)	(1,433)
Total, fair value	42,793	140,837
Total, unrealized losses	(37)	(1,439)
Corporate bonds
Debt Securities, Available-for-sale [Line Items]
Less than 12 months, fair value		0
Less than 12 months, unrealized losses		0
More than 12 months, fair value		1,673
More than 12 months, unrealized losses		(22)
Total, fair value		1,673
Total, unrealized losses		(22)
Mortgage-backed securities
Debt Securities, Available-for-sale [Line Items]
Less than 12 months, fair value		22,285
Less than 12 months, unrealized losses		(397)
More than 12 months, fair value		0
More than 12 months, unrealized losses		0
Total, fair value		22,285
Total, unrealized losses		(397)
Collateralized loan obligations
Debt Securities, Available-for-sale [Line Items]
Less than 12 months, fair value	14,972	13,886
Less than 12 months, unrealized losses	(17)	(104)
More than 12 months, fair value	7,951	0
More than 12 months, unrealized losses	(40)	0
Total, fair value	22,923	13,886
Total, unrealized losses	$ (57)	$ (104)