Investment Securities (Fair Value to Amortized Cost Basis) (Details) - USD ($) $ in Thousands	Mar. 31, 2023	Dec. 31, 2022
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	$ 514,282	$ 521,025
Gross Unrealized Gains	51	73
Gross Unrealized Losses	50,384	58,352
Estimated Fair Value	463,949	462,746
CRA investment fund	4,380	4,286
Other equity securities	207	207
Total investment securities, amortized cost	518,869	525,518
Total investment securities, gross unrealized gains	51	73
Total investment securities, gross unrealized losses	50,384	58,352
Total investment securities, estimated fair value	468,536	467,239
Residential Mortgage Backed Securities ("MBS")
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	125,680	126,861
Gross Unrealized Gains	11	12
Gross Unrealized Losses	11,660	13,203
Estimated Fair Value	114,031	113,670
Residential Collateralized Mortgage Obligations ("CMOs")
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	173,344	175,905
Gross Unrealized Gains	7	8
Gross Unrealized Losses	14,623	16,500
Estimated Fair Value	158,728	159,413
U.S. Agency
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	14,714	14,658
Gross Unrealized Gains	0	0
Gross Unrealized Losses	2,029	2,302
Estimated Fair Value	12,685	12,356
Residential CMOs
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	12,369	12,593
Gross Unrealized Gains	3	13
Gross Unrealized Losses	373	400
Estimated Fair Value	11,999	12,206
Student Loan Trust ABSs
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	46,771	49,566
Gross Unrealized Gains	29	39
Gross Unrealized Losses	1,866	2,293
Estimated Fair Value	44,934	47,312
Municipal bonds
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	99,686	99,766
Gross Unrealized Gains	0	0
Gross Unrealized Losses	16,794	20,148
Estimated Fair Value	82,892	79,618
Corporate bonds
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	4,867	4,863
Gross Unrealized Gains	0	0
Gross Unrealized Losses	504	459
Estimated Fair Value	4,363	4,404
U.S. government obligations
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	36,851	36,813
Gross Unrealized Gains	1	1
Gross Unrealized Losses	2,535	3,047
Estimated Fair Value	34,317	33,767
CRA investment fund
Debt and Equity Securities, FV-NI [Line Items]
CRA investment fund	4,380	4,286
Other equity securities
Debt and Equity Securities, FV-NI [Line Items]
Other equity securities	$ 207	$ 207