Loans and Allowance for Credit Losses on Loans - Schedule of Allowance for Credit Losses on Loans and Recorded Investment by Portfolio Segment and Impairment Methodology (Details) - USD ($) $ in Thousands	Jun. 30, 2023	Mar. 31, 2023	Jan. 01, 2023	Dec. 31, 2022	Jun. 30, 2022	Mar. 31, 2022	Dec. 31, 2021
Financing Receivable Allowance For Credit Losses [Line Items]
Allowance for Loans Individually Evaluated for Impairment	$ 57			$ 279
Allowance for Loan Collectively Evaluated for Impairment	20,745			18,962
Allowance for loan losses, Total	20,802	$ 20,814	$ 21,165	19,241	$ 17,702	$ 16,672	$ 16,123
Loans Individually Evaluated for Impairment	6,667			702
Loans Collectively Evaluated for Impairment	1,709,530			1,677,590
Total	1,716,197			1,678,292
Accrued interest receivable	6,800			6,400
Collateralized Mortgage-Backed Securities
Financing Receivable Allowance For Credit Losses [Line Items]
Total	6,667
Collateralized Mortgage-Backed Securities | Loans Insured or Guaranteed by non-US Government Authorities
Financing Receivable Allowance For Credit Losses [Line Items]
Total	3,600
Commercial Real Estate
Financing Receivable Allowance For Credit Losses [Line Items]
Allowance for Loans Individually Evaluated for Impairment	0			0
Allowance for Loan Collectively Evaluated for Impairment	6,784			6,951
Allowance for loan losses, Total	6,784	6,784		6,951	7,743	6,480	8,150
Loans Individually Evaluated for Impairment	0			0
Loans Collectively Evaluated for Impairment	847,863			842,208
Total	847,863			842,208
SBA—real estate
Financing Receivable Allowance For Credit Losses [Line Items]
Allowance for Loans Individually Evaluated for Impairment	57			0
Allowance for Loan Collectively Evaluated for Impairment	1,161			1,607
Allowance for loan losses, Total	1,218	1,218		1,607	1,800	1,750	2,022
Loans Individually Evaluated for Impairment	4,362			423
Loans Collectively Evaluated for Impairment	220,114			220,917
Total	224,476			221,340
SBA—real estate | Collateralized Mortgage-Backed Securities
Financing Receivable Allowance For Credit Losses [Line Items]
Total	4,362
SBA—non-real estate
Financing Receivable Allowance For Credit Losses [Line Items]
Allowance for Loans Individually Evaluated for Impairment	0			0
Allowance for Loan Collectively Evaluated for Impairment	55			207
Allowance for loan losses, Total	55	67	65	207	135	169	199
Loans Individually Evaluated for Impairment	0			0
Loans Collectively Evaluated for Impairment	14,309			13,377
Total	14,309			13,377
C&I
Financing Receivable Allowance For Credit Losses [Line Items]
Allowance for Loans Individually Evaluated for Impairment	0			279
Allowance for Loan Collectively Evaluated for Impairment	1,270			1,364
Allowance for loan losses, Total	1,270	1,270	1,323	1,643	2,102	3,492	2,848
Loans Individually Evaluated for Impairment	0			279
Loans Collectively Evaluated for Impairment	112,160			116,672
Total	112,160			116,951
Home mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Allowance for Loans Individually Evaluated for Impairment	0			0
Allowance for Loan Collectively Evaluated for Impairment	11,472			8,826
Allowance for loan losses, Total	11,472	11,472	10,579	8,826	5,913	4,768	2,891
Loans Individually Evaluated for Impairment	2,305			0
Loans Collectively Evaluated for Impairment	513,921			482,949
Total	516,226			482,949
Home mortgage | Collateralized Mortgage-Backed Securities
Financing Receivable Allowance For Credit Losses [Line Items]
Total	2,305
Consumer
Financing Receivable Allowance For Credit Losses [Line Items]
Allowance for Loans Individually Evaluated for Impairment	0			0
Allowance for Loan Collectively Evaluated for Impairment	3			7
Allowance for loan losses, Total	3	$ 3	$ 3	7	$ 9	$ 13	$ 13
Loans Individually Evaluated for Impairment	0			0
Loans Collectively Evaluated for Impairment	1,163			1,467
Total	$ 1,163			$ 1,467