Securities - HTM Contractual Maturities (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
HTM, Amortized Cost, Rolling Maturities
Due in one year or less	$ 453
Due after one year through five years	987
Due after five years through ten years	6,160
Due after ten years	63,662
Total	71,262
Amortized cost	355,110	$ 386,326
HTM, Fair Value, Rolling Maturities
Due in one year or less	456
Due after one year through five years	994
Due after five years through ten years	6,264
Due after ten years	64,748
Total	72,462
Fair Value	369,614	388,930
Residential Mortgage Backed Securities
HTM, Amortized Cost, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	16,809
Amortized cost	16,809	17,776
HTM, Fair Value, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	17,485
Fair Value	17,485	18,071
Collateralized Mortgage Obligations
HTM, Amortized Cost, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	106,926
Amortized cost	106,926	113,894
HTM, Fair Value, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	109,149
Fair Value	109,149	113,216
Commercial mortgage-backed securities
HTM, Amortized Cost, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	160,113
Amortized cost	160,113	161,624
HTM, Fair Value, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	170,518
Fair Value	$ 170,518	$ 163,779