Loans and Credit Quality - Loan Portfolio Segmented By Risk Class (Details) - USD ($) $ in Thousands	Dec. 31, 2020	Dec. 31, 2019
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	$ 1,455,785	$ 1,048,456
Less: Unearned origination fees,  net of origination costs	(11,735)	(5,085)
Total loans	1,444,050	1,043,371
Asset Quality Rating - Pass
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	1,409,330	994,583
Asset Quality Rating - Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	28,905	29,660
Asset Quality Rating - Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	16,063	24,213
Asset Quality Rating - Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	1,487
Commercial
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	780,058	412,690
Total loans	772,468	411,327
Commercial | Asset Quality Rating - Pass
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	765,952	394,107
Commercial | Asset Quality Rating - Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	6,241	2,279
Commercial | Asset Quality Rating - Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	6,378	16,304
Commercial | Asset Quality Rating - Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	1,487
Real estate construction one-to-four family
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	38,467	38,818
Total loans	38,180	38,503
Real estate construction one-to-four family | Asset Quality Rating - Pass
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	37,380	34,132
Real estate construction one-to-four family | Asset Quality Rating - Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	385	3,337
Real estate construction one-to-four family | Asset Quality Rating - Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	702	1,349
Real estate construction one-to-four family | Asset Quality Rating - Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	0
Real estate construction other
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	80,315	61,808
Total loans	79,403	60,906
Real estate construction other | Asset Quality Rating - Pass
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	80,315	61,808
Real estate construction other | Asset Quality Rating - Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	0	0
Real estate construction other | Asset Quality Rating - Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	0	0
Real estate construction other | Asset Quality Rating - Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	0
Real estate term owner occupied
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	163,597	138,891
Total loans	162,724	138,181
Real estate term owner occupied | Asset Quality Rating - Pass
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	153,607	129,959
Real estate term owner occupied | Asset Quality Rating - Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	3,028	3,828
Real estate term owner occupied | Asset Quality Rating - Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	6,962	5,104
Real estate term owner occupied | Asset Quality Rating - Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	0
Real estate term non-owner occupied
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	309,074	312,960
Total loans	307,247	311,302
Real estate term non-owner occupied | Asset Quality Rating - Pass
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	291,382	295,482
Real estate term non-owner occupied | Asset Quality Rating - Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	17,097	17,478
Real estate term non-owner occupied | Asset Quality Rating - Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	595	0
Real estate term non-owner occupied | Asset Quality Rating - Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	0
Real estate term other
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	46,620	42,506
Total loans	46,230	42,200
Real estate term other | Asset Quality Rating - Pass
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	43,290	38,771
Real estate term other | Asset Quality Rating - Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	2,154	2,559
Real estate term other | Asset Quality Rating - Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	1,176	1,176
Real estate term other | Asset Quality Rating - Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	0
Consumer secured by 1st deeds of trust
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	15,585	16,198
Total loans	15,548	16,191
Consumer secured by 1st deeds of trust | Asset Quality Rating - Pass
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	15,441	15,860
Consumer secured by 1st deeds of trust | Asset Quality Rating - Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	0	179
Consumer secured by 1st deeds of trust | Asset Quality Rating - Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	144	159
Consumer secured by 1st deeds of trust | Asset Quality Rating - Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	0
Consumer other
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	22,069	24,585
Total loans	22,250	24,761
Consumer other | Asset Quality Rating - Pass
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	21,963	24,464
Consumer other | Asset Quality Rating - Special Mention
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	0	0
Consumer other | Asset Quality Rating - Substandard
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	106	$ 121
Consumer other | Asset Quality Rating - Doubtful
Financing Receivable, Credit Quality Indicator [Line Items]
Loans, gross	$ 0