Investment Securities (Fair Value to Amortized Cost Basis) (Details) - USD ($) $ in Thousands	Dec. 31, 2022	Dec. 31, 2021
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	$ 521,025	$ 500,478
Gross Unrealized Gains	73	3,390
Gross Unrealized Losses	58,352	6,029
Estimated Fair Value	462,746	497,839
CRA investment fund	4,286	4,772
Other equity securities	207	207
Total investment securities, Amortized Cost	525,518	505,457
Total investment securities, Gross Unrealized Gains	73	3,390
Total investment securities, Gross Unrealized Losses	58,352	6,029
Total investment securities, Estimated Fair Value	467,239	502,818
Residential mortgage-backed securities ("MBS")
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	126,861	121,125
Gross Unrealized Gains	12	1,057
Gross Unrealized Losses	13,203	2,266
Estimated Fair Value	113,670	119,916
Residential collateralized mortgage obligations ("CMOs")
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	175,905	198,780
Gross Unrealized Gains	8	710
Gross Unrealized Losses	16,500	2,367
Estimated Fair Value	159,413	197,123
U.S. Agency
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	14,658	14,433
Gross Unrealized Gains	0	11
Gross Unrealized Losses	2,302	140
Estimated Fair Value	12,356	14,304
Residential CMOs
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	12,593	220
Gross Unrealized Gains	13	5
Gross Unrealized Losses	400	4
Estimated Fair Value	12,206	221
Student loan trust ABSs
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	49,566	56,422
Gross Unrealized Gains	39	438
Gross Unrealized Losses	2,293	286
Estimated Fair Value	47,312	56,574
Municipal bonds
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	99,766	92,556
Gross Unrealized Gains	0	1,169
Gross Unrealized Losses	20,148	884
Estimated Fair Value	79,618	92,841
Corporate bonds
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	4,863
Gross Unrealized Gains	0
Gross Unrealized Losses	459
Estimated Fair Value	4,404
U.S. government obligations
Debt and Equity Securities, FV-NI [Line Items]
Amortized Cost	36,813	16,942
Gross Unrealized Gains	1	0
Gross Unrealized Losses	3,047	82
Estimated Fair Value	33,767	16,860
CRA investment fund
Debt and Equity Securities, FV-NI [Line Items]
CRA investment fund	4,286	4,772
Other equity securities
Debt and Equity Securities, FV-NI [Line Items]
Other equity securities	$ 207	$ 207