Securities - HTM Contractual Maturities (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Dec. 31, 2019
HTM, Amortized Cost, Rolling Maturities
Due in one year or less	$ 452
Due after one year through five years	987
Due after five years through ten years	7,068
Due after ten years	62,977
Total	71,484
Amortized cost	343,198	$ 386,326
HTM, Fair Value, Rolling Maturities
Due in one year or less	456
Due after one year through five years	996
Due after five years through ten years	7,313
Due after ten years	64,841
Total	73,606
Fair Value	359,542	388,930
Residential Mortgage Backed Securities
HTM, Amortized Cost, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	15,693
Amortized cost	15,693	17,776
HTM, Fair Value, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	16,539
Fair Value	16,539	18,071
Collateralized Mortgage Obligations
HTM, Amortized Cost, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	96,413
Amortized cost	96,413	113,894
HTM, Fair Value, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	98,844
Fair Value	98,844	113,216
Commercial mortgage-backed securities
HTM, Amortized Cost, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	159,608
Amortized cost	159,608	161,624
HTM, Fair Value, Rolling Maturities
Mortgage-backed securities, collateralized mortgage obligations and commercial mortgage-backed securities	170,553
Fair Value	$ 170,553	$ 163,779