Investment Securities Schedule of Available for Sale Securities (Details) $ in Thousands	Dec. 31, 2019 USD ($) position	Dec. 31, 2018 USD ($) position
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	$ 356,710	$ 322,491
Available-for-Sale	357,334	317,535
Gross Unrealized Gains	1,904	290
Gross Unrealized Losses	1,280	5,246
Maturities of Debt Securities, at Amortized Cost:
Within One Year	43
From 1 - 5 Years	305,572
From 5 - 10 Years	50,655
Over 10 Years	440
Maturities of Debt Securities, at Fair Value:
Within One Year	44
From 1 - 5 Years	306,688
From 5 - 10 Years	50,162
Over 10 Years	440
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	52,491	107,550
12 Months or Longer	97,964	172,192
Total	$ 150,455	$ 279,742
Number of Securities in a Continuous Loss Position | position	55	97
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 317	$ 841
12 Months or Longer	963	4,405
Total	1,280	5,246
U.S. Treasury and Agency Obligations
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	5,002	47,071
Available-for-Sale	5,054	46,765
Gross Unrealized Gains	52	0
Gross Unrealized Losses	0	306
Maturities of Debt Securities, at Amortized Cost:
Within One Year	0
From 1 - 5 Years	5,002
From 5 - 10 Years	0
Over 10 Years	0
Maturities of Debt Securities, at Fair Value:
Within One Year	0
From 1 - 5 Years	5,054
From 5 - 10 Years	0
Over 10 Years	0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	0	0
12 Months or Longer	0	46,765
Total	$ 0	$ 46,765
Number of Securities in a Continuous Loss Position | position	0	10
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 0	$ 0
12 Months or Longer	0	306
Total	0	306
U.S. Treasury and Agency Obligations | Agency Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	5,002	47,071
Available-for-Sale	5,054	46,765
State and Municipal Obligations
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	764	1,193
Available-for-Sale	764	1,195
Gross Unrealized Gains	0	2
Gross Unrealized Losses	0	0
Maturities of Debt Securities, at Amortized Cost:
Within One Year	25
From 1 - 5 Years	299
From 5 - 10 Years	0
Over 10 Years	440
Maturities of Debt Securities, at Fair Value:
Within One Year	26
From 1 - 5 Years	298
From 5 - 10 Years	0
Over 10 Years	440
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	0	0
12 Months or Longer	0	0
Total	$ 0	$ 0
Number of Securities in a Continuous Loss Position | position	0	0
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 0	$ 0
12 Months or Longer	0	0
Total	0	0
Collateralized Mortgage Backed Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	349,944	273,227
Available-for-Sale	350,716	268,775
Gross Unrealized Gains	1,852	288
Gross Unrealized Losses	1,080	4,740
Maturities of Debt Securities, at Amortized Cost:
Within One Year	18
From 1 - 5 Years	300,271
From 5 - 10 Years	49,655
Over 10 Years	0
Maturities of Debt Securities, at Fair Value:
Within One Year	18
From 1 - 5 Years	301,336
From 5 - 10 Years	49,362
Over 10 Years	0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	52,491	107,550
12 Months or Longer	97,164	124,627
Total	$ 149,655	$ 232,177
Number of Securities in a Continuous Loss Position | position	54	86
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 317	$ 841
12 Months or Longer	763	3,899
Total	1,080	4,740
Collateralized Mortgage Backed Securities | US Government Agencies Debt Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	61,102	72,095
Available-for-Sale	60,616	71,800
Collateralized Mortgage Backed Securities | US Government-sponsored Enterprises Debt Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	288,842	201,132
Available-for-Sale	290,100	196,975
Corporate Debt Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	1,000	1,000
Available-for-Sale	800	800
Gross Unrealized Gains	0	0
Gross Unrealized Losses	200	200
Maturities of Debt Securities, at Amortized Cost:
Within One Year	0
From 1 - 5 Years	0
From 5 - 10 Years	1,000
Over 10 Years	0
Maturities of Debt Securities, at Fair Value:
Within One Year	0
From 1 - 5 Years	0
From 5 - 10 Years	800
Over 10 Years	0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	0	0
12 Months or Longer	800	800
Total	$ 800	$ 800
Number of Securities in a Continuous Loss Position | position	1	1
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 0	$ 0
12 Months or Longer	200	200
Total	200	200
Mututal Funds and Equity Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost		0
Available-for-Sale		0
Gross Unrealized Gains		0
Gross Unrealized Losses		0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months		0
12 Months or Longer		0
Total		$ 0
Number of Securities in a Continuous Loss Position | position		0
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months		$ 0
12 Months or Longer		0
Total		0
Collateral Pledged
Available-for-Sale Securities
Available-For-Sale Securities, Pledged as Collateral, at Fair Value	$ 164,426	$ 236,163