Investment Securities - Unrealized Losses (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Fair Value
Less than 12 Months	$ 96,353	$ 145,676
12 Months or Longer	56,963	107,451
Total	153,316	253,127
Unrealized Losses
Less than 12 Months	(2,312)	(558)
12 Months or Longer	(894)	(950)
Total	(3,206)	(1,508)
U.S. Treasury and U.S. Government-sponsored agencies
Fair Value
Less than 12 Months	5,880	45,999
12 Months or Longer	0	0
Total	5,880	45,999
Unrealized Losses
Less than 12 Months	(120)	(84)
12 Months or Longer	0	0
Total	(120)	(84)
Municipal securities
Fair Value
Less than 12 Months	27,434	13,761
12 Months or Longer	0	0
Total	27,434	13,761
Unrealized Losses
Less than 12 Months	(415)	(102)
12 Months or Longer	0	0
Total	(415)	(102)
Residential
Fair Value
Less than 12 Months	2,045	14,272
12 Months or Longer	27,992	60,232
Total	30,037	74,504
Unrealized Losses
Less than 12 Months	(6)	(66)
12 Months or Longer	(224)	(439)
Total	(230)	(505)
Commercial
Fair Value
Less than 12 Months	32,562	56,263
12 Months or Longer	25,485	43,623
Total	58,047	99,886
Unrealized Losses
Less than 12 Months	(683)	(177)
12 Months or Longer	(592)	(472)
Total	(1,275)	(649)
Corporate obligations
Fair Value
Less than 12 Months	7,788	998
12 Months or Longer	1,980	1,987
Total	9,768	2,985
Unrealized Losses
Less than 12 Months	(240)	(2)
12 Months or Longer	(20)	(13)
Total	(260)	(15)
Other asset-backed securities
Fair Value
Less than 12 Months	20,644
Other asset-backed securities, Less than 12 Months		14,383
12 Months or Longer	1,506
Other asset-backed securities, 12 Months or Longer		1,609
Total	22,150
Other asset-backed securities, Total		15,992
Unrealized Losses
Less than 12 Months	(848)
Other asset-backed, Less than 12 Months		127
12 Months or Longer	(58)
Other asset-backed securities, 12 Months or Longer		26
Total	$ (906)
Other asset-backed securities, Total		$ 153