Investment Securities Schedule of Available for Sale Securities (Details) $ in Thousands	Dec. 31, 2020 USD ($) security	Dec. 31, 2019 USD ($) security
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	$ 357,497	$ 356,710
Available-for-Sale	365,287	357,334
Gross Unrealized Gains	8,118	1,904
Gross Unrealized Losses	328	1,280
Maturities of Debt Securities, at Amortized Cost:
Within One Year	12,291
From 1 - 5 Years	323,870
From 5 - 10 Years	21,336
Over 10 Years	0
Maturities of Debt Securities, at Fair Value:
Within One Year	12,441
From 1 - 5 Years	331,785
From 5 - 10 Years	21,061
Over 10 Years	0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	29,926	52,491
12 Months or Longer	5,682	97,964
Total	$ 35,608	$ 150,455
Number of Securities in a Continuous Loss Position | security	6	55
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 74	$ 317
12 Months or Longer	254	963
Total	328	1,280
U.S. Treasury and Agency Obligations
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	65,002	5,002
Available-for-Sale	65,112	5,054
Gross Unrealized Gains	184	52
Gross Unrealized Losses	74	0
Maturities of Debt Securities, at Amortized Cost:
Within One Year	0
From 1 - 5 Years	50,002
From 5 - 10 Years	15,000
Over 10 Years	0
Maturities of Debt Securities, at Fair Value:
Within One Year	0
From 1 - 5 Years	50,133
From 5 - 10 Years	14,979
Over 10 Years	0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	29,926	0
12 Months or Longer	0	0
Total	$ 29,926	$ 0
Number of Securities in a Continuous Loss Position | security	4	0
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 74	$ 0
12 Months or Longer	0	0
Total	74	0
U.S. Treasury and Agency Obligations | Agency Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	65,002	5,002
Available-for-Sale	65,112	5,054
State and Municipal Obligations
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	528	764
Available-for-Sale	528	764
Gross Unrealized Gains	0	0
Gross Unrealized Losses	0	0
Maturities of Debt Securities, at Amortized Cost:
Within One Year	68
From 1 - 5 Years	60
From 5 - 10 Years	400
Over 10 Years	0
Maturities of Debt Securities, at Fair Value:
Within One Year	68
From 1 - 5 Years	60
From 5 - 10 Years	400
Over 10 Years	0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	0	0
12 Months or Longer	0	0
Total	$ 0	$ 0
Number of Securities in a Continuous Loss Position | security	0	0
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 0	$ 0
12 Months or Longer	0	0
Total	0	0
Collateralized Mortgage Backed Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	290,967	349,944
Available-for-Sale	298,847	350,716
Gross Unrealized Gains	7,934	1,852
Gross Unrealized Losses	54	1,080
Maturities of Debt Securities, at Amortized Cost:
Within One Year	12,223
From 1 - 5 Years	273,808
From 5 - 10 Years	4,936
Over 10 Years	0
Maturities of Debt Securities, at Fair Value:
Within One Year	12,373
From 1 - 5 Years	281,592
From 5 - 10 Years	4,882
Over 10 Years	0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	0	52,491
12 Months or Longer	4,882	97,164
Total	$ 4,882	$ 149,655
Number of Securities in a Continuous Loss Position | security	1	54
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 0	$ 317
12 Months or Longer	54	763
Total	54	1,080
Collateralized Mortgage Backed Securities | US Government Agencies Debt Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	12,696	61,102
Available-for-Sale	12,683	60,616
Collateralized Mortgage Backed Securities | US Government-sponsored Enterprises Debt Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	278,271	288,842
Available-for-Sale	286,164	290,100
Corporate Debt Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost	1,000	1,000
Available-for-Sale	800	800
Gross Unrealized Gains	0	0
Gross Unrealized Losses	200	200
Maturities of Debt Securities, at Amortized Cost:
Within One Year	0
From 1 - 5 Years	0
From 5 - 10 Years	1,000
Over 10 Years	0
Maturities of Debt Securities, at Fair Value:
Within One Year	0
From 1 - 5 Years	0
From 5 - 10 Years	800
Over 10 Years	0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	0	0
12 Months or Longer	800	800
Total	$ 800	$ 800
Number of Securities in a Continuous Loss Position | security	1	1
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 0	$ 0
12 Months or Longer	200	200
Total	200	200
Mututal Funds and Equity Securities
Available-for-Sale Securities
Available-For-Sale Securities, at Amortized Cost		0
Available-for-Sale		0
Gross Unrealized Gains		0
Gross Unrealized Losses		0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months		0
12 Months or Longer		0
Total		$ 0
Number of Securities in a Continuous Loss Position | security		0
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months		$ 0
12 Months or Longer		0
Total		0
Collateral Pledged
Available-for-Sale Securities
Available-For-Sale Securities, Pledged as Collateral, at Fair Value	$ 244,411	$ 164,426