Loans - Classification of Loans By Class (Details) - USD ($) $ in Thousands	Jun. 30, 2023	Dec. 31, 2022
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		$ 2,106,559
Total Loans	$ 2,167,367
SBA 504 loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		35,077
Total Loans	31,657
SBA loans held for investment
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		38,468
Total Loans	39,878
SBA PPP loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		5,908
Total Loans	2,555
Commercial loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		1,187,543
Total Loans	1,256,032
Commercial loans | SBA 504 loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		35,077
Commercial loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		903,126
Total Loans	931,756
Commercial loans | Commercial real estate construction
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		131,774
Total Loans	161,882
Commercial loans | Consumer other
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		117,566
Total Loans	130,737
Residential mortgage loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		605,091
Total Loans	633,414
Consumer loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		78,164
Total Loans	75,990
Consumer loans | Home equity
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		68,310
Total Loans	68,379
Consumer loans | Consumer other
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		9,854
Total Loans	7,611
Residential construction loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		163,457
Total Loans	139,424
Total
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		2,078,631
Total Loans	2,147,293
SBA loans held for sale
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total loans		$ 27,928
Total Loans	$ 20,074