Allowance for Credit Losses and Reserve for Unfunded Loan Commitments - Allowance for Credit Losses on Basis of Impairment Method (Details) - USD ($) $ in Thousands	Dec. 31, 2024	Dec. 31, 2023	Dec. 31, 2022
Financing Receivable, Allowance for Credit Losses [Line Items]
Total	$ 26,788	$ 25,854	$ 25,196
Total Loans	2,260,657	2,172,063
SBA held for investment including PPP loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Individually evaluated for impairment	755	348
Collectively evaluated for impairment	780	873
Total	1,535	1,221
Individually evaluated for impairment	3,850	3,444
Collectively evaluated for impairment	34,459	37,458
Total Loans	38,309	40,902
SBA loans held for investment
Financing Receivable, Allowance for Credit Losses [Line Items]
Total	1,535	1,221	875
Total Loans	36,859	38,584
Commercial loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Individually evaluated for impairment	62	341
Collectively evaluated for impairment	17,299	15,535
Total	17,361	15,876	15,254
Individually evaluated for impairment	2,974	1,948
Collectively evaluated for impairment	1,408,655	1,275,512
Total Loans	1,411,629	1,277,460
Residential mortgage loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Individually evaluated for impairment	52	306
Collectively evaluated for impairment	6,202	6,223
Total	6,254	6,529	5,450
Individually evaluated for impairment	6,471	11,272
Collectively evaluated for impairment	624,456	620,234
Total Loans	630,927	631,506
Consumer loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Individually evaluated for impairment	0	0
Collectively evaluated for impairment	775	1,022
Total	775	1,022	990
Individually evaluated for impairment	0	381
Collectively evaluated for impairment	76,711	72,295
Total Loans	76,711	72,676
Residential construction loans
Financing Receivable, Allowance for Credit Losses [Line Items]
Individually evaluated for impairment	102	0
Collectively evaluated for impairment	761	1,206
Total	863	1,206	$ 2,627
Individually evaluated for impairment	547	2,141
Collectively evaluated for impairment	90,371	129,136
Total Loans	90,918	131,277
Total loans held for investment including PPP
Financing Receivable, Allowance for Credit Losses [Line Items]
Total Loans	2,248,494	2,153,821
Total loans held for investment excluding SBA PPP
Financing Receivable, Allowance for Credit Losses [Line Items]
Individually evaluated for impairment	971	995
Collectively evaluated for impairment	25,817	24,859
Total	26,788	25,854
Individually evaluated for impairment	13,842	19,186
Collectively evaluated for impairment	2,234,652	2,134,635
Total Loans	$ 2,248,494	$ 2,153,821