Loans - Credit Quality Indicators (Details) - USD ($) $ in Thousands	Mar. 31, 2022	Dec. 31, 2021
Financing Receivable, Recorded Investment [Line Items]
Total loans	$ 1,701,384	$ 1,649,448
SBA 504 loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	27,534	27,479
Pass | SBA 504 loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	27,534	27,479
SBA loans held for investment
Financing Receivable, Recorded Investment [Line Items]
Total loans	33,048	36,075
SBA loans held for investment | Pass
Financing Receivable, Recorded Investment [Line Items]
Total loans	31,980	34,959
SBA loans held for investment | Special mention
Financing Receivable, Recorded Investment [Line Items]
Total loans	735	745
SBA loans held for investment | Substandard
Financing Receivable, Recorded Investment [Line Items]
Total loans	333	371
SBA and commercial loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,041,577	1,014,251
SBA and commercial loans | Pass
Financing Receivable, Recorded Investment [Line Items]
Total loans	1,020,978	995,673
SBA and commercial loans | Special mention
Financing Receivable, Recorded Investment [Line Items]
Total loans	15,722	13,601
SBA and commercial loans | Substandard
Financing Receivable, Recorded Investment [Line Items]
Total loans	4,877	4,977
SBA PPP loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	28,618	46,450
SBA PPP loans | Pass
Financing Receivable, Recorded Investment [Line Items]
Total loans	28,618	46,450
Commercial loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	979,911	931,726
Commercial loans | Real Estate Loan [Member]
Financing Receivable, Recorded Investment [Line Items]
Total loans	728,652	704,674
Commercial loans | Commercial real estate construction
Financing Receivable, Recorded Investment [Line Items]
Total loans	103,380	89,670
Commercial loans | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	120,345	109,903
Commercial loans | Pass
Financing Receivable, Recorded Investment [Line Items]
Total loans	960,380	914,264
Commercial loans | Pass | Real Estate Loan [Member]
Financing Receivable, Recorded Investment [Line Items]
Total loans	716,912	694,627
Commercial loans | Pass | Commercial real estate construction
Financing Receivable, Recorded Investment [Line Items]
Total loans	103,380	86,770
Commercial loans | Pass | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	112,554	105,388
Commercial loans | Special mention
Financing Receivable, Recorded Investment [Line Items]
Total loans	14,987	12,856
Commercial loans | Special mention | Real Estate Loan [Member]
Financing Receivable, Recorded Investment [Line Items]
Total loans	9,705	7,980
Commercial loans | Special mention | Commercial real estate construction
Financing Receivable, Recorded Investment [Line Items]
Total loans		2,900
Commercial loans | Special mention | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	5,282	1,976
Commercial loans | Substandard
Financing Receivable, Recorded Investment [Line Items]
Total loans	4,544	4,606
Commercial loans | Substandard | Real Estate Loan [Member]
Financing Receivable, Recorded Investment [Line Items]
Total loans	2,035	2,067
Commercial loans | Substandard | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	2,509	2,539
Residential mortgage loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	427,165	409,355
Residential mortgage loans | Performing
Financing Receivable, Recorded Investment [Line Items]
Total loans	424,166	406,093
Residential mortgage loans | Nonperforming
Financing Receivable, Recorded Investment [Line Items]
Total loans	2,999	3,262
Consumer loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	77,702	77,944
Consumer loans | Home equity
Financing Receivable, Recorded Investment [Line Items]
Total loans	63,536	65,380
Consumer loans | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	14,166	12,564
Consumer loans | Performing
Financing Receivable, Recorded Investment [Line Items]
Total loans	77,502	77,734
Consumer loans | Performing | Home equity
Financing Receivable, Recorded Investment [Line Items]
Total loans	63,336	65,170
Consumer loans | Performing | Consumer other
Financing Receivable, Recorded Investment [Line Items]
Total loans	14,166	12,564
Consumer loans | Nonperforming
Financing Receivable, Recorded Investment [Line Items]
Total loans	200	210
Consumer loans | Nonperforming | Home equity
Financing Receivable, Recorded Investment [Line Items]
Total loans	200	210
Residential construction loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	129,658	120,525
Residential construction loans | Performing
Financing Receivable, Recorded Investment [Line Items]
Total loans	126,385	117,403
Residential construction loans | Nonperforming
Financing Receivable, Recorded Investment [Line Items]
Total loans	3,273	3,122
Residential mortgage, consumer and residential construction loans
Financing Receivable, Recorded Investment [Line Items]
Total loans	634,525	607,824
Residential mortgage, consumer and residential construction loans | Performing
Financing Receivable, Recorded Investment [Line Items]
Total loans	628,053	601,230
Residential mortgage, consumer and residential construction loans | Nonperforming
Financing Receivable, Recorded Investment [Line Items]
Total loans	6,472	6,594
SBA loans held for sale
Financing Receivable, Recorded Investment [Line Items]
Total loans	$ 25,282	$ 27,373