Loans and Allowance for Loan Losses - Internal Risk Rating Summary (Details) - USD ($) $ in Thousands	Sep. 30, 2021	Dec. 31, 2020	Sep. 30, 2020
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	$ 1,746,178	$ 1,415,362	$ 1,390,854
Total Loans	1,766,288	1,454,801
SBA PPP
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	119,400
Commercial and non-residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	1,430,290	1,141,114	1,117,326
Commercial and non-residential real estate | Commercial business
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	619,334	523,891
Commercial and non-residential real estate | Commercial real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	564,576	423,122
Commercial and non-residential real estate | Acquisition and development
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	99,042	112,126
Commercial and non-residential real estate | SBA PPP
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	147,338	81,975
Residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	269,967	240,264	234,758
Home Equity
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	23,777	30,828	34,784
Consumer
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	22,144	3,156	$ 3,986
Purchased credit impaired loans
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	20,110	39,439
Purchased credit impaired loans | Commercial and non-residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	15,079	21,008
Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	2,938	17,604
Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	11,595	1,269
Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	546	2,135
Purchased credit impaired loans | Residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	4,430	16,943
Purchased credit impaired loans | Consumer
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	601	1,488
Pass
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	1,636,759	1,285,163
Pass | Commercial and non-residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	1,331,468	1,015,512
Pass | Commercial and non-residential real estate | Commercial business
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	589,196	496,222
Pass | Commercial and non-residential real estate | Commercial real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	508,729	356,544
Pass | Commercial and non-residential real estate | Acquisition and development
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	86,205	80,771
Pass | Commercial and non-residential real estate | SBA PPP
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	147,338	81,975
Pass | Residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	259,864	236,250
Pass | Home Equity
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	23,304	30,277
Pass | Consumer
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	22,123	3,124
Pass | Purchased credit impaired loans
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	14,025	31,558
Pass | Purchased credit impaired loans | Commercial and non-residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	10,403	15,145
Pass | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	2,360	12,263
Pass | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	7,784	982
Pass | Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	259	1,900
Pass | Purchased credit impaired loans | Residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	3,586	15,157
Pass | Purchased credit impaired loans | Consumer
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	36	1,256
Special Mention
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	44,564	67,935
Special Mention | Commercial and non-residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	43,251	66,574
Special Mention | Commercial and non-residential real estate | Commercial business
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	13,623	9,529
Special Mention | Commercial and non-residential real estate | Commercial real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	22,004	32,044
Special Mention | Commercial and non-residential real estate | Acquisition and development
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	7,624	25,001
Special Mention | Commercial and non-residential real estate | SBA PPP
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	0	0
Special Mention | Residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	917	948
Special Mention | Home Equity
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	378	381
Special Mention | Consumer
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	18	32
Special Mention | Purchased credit impaired loans
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	1,785	139
Special Mention | Purchased credit impaired loans | Commercial and non-residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	1,785	139
Special Mention | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	158	136
Special Mention | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	1,549	3
Special Mention | Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	78	0
Special Mention | Purchased credit impaired loans | Residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	0	0
Special Mention | Purchased credit impaired loans | Consumer
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	0	0
Substandard
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	59,442	58,270
Substandard | Commercial and non-residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	50,746	55,230
Substandard | Commercial and non-residential real estate | Commercial business
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	12,910	17,045
Substandard | Commercial and non-residential real estate | Commercial real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	33,687	34,001
Substandard | Commercial and non-residential real estate | Acquisition and development
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	4,149	4,184
Substandard | Commercial and non-residential real estate | SBA PPP
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	0	0
Substandard | Residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	8,693	2,896
Substandard | Home Equity
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	0	144
Substandard | Consumer
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	3	0
Substandard | Purchased credit impaired loans
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	3,970	2,273
Substandard | Purchased credit impaired loans | Commercial and non-residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	2,563	608
Substandard | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	211	345
Substandard | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	2,189	263
Substandard | Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	163	0
Substandard | Purchased credit impaired loans | Residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	844	1,665
Substandard | Purchased credit impaired loans | Consumer
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	563	0
Doubtful
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	5,413	3,994
Doubtful | Commercial and non-residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	4,825	3,798
Doubtful | Commercial and non-residential real estate | Commercial business
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	3,605	1,095
Doubtful | Commercial and non-residential real estate | Commercial real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	156	533
Doubtful | Commercial and non-residential real estate | Acquisition and development
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	1,064	2,170
Doubtful | Commercial and non-residential real estate | SBA PPP
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	0	0
Doubtful | Residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	493	170
Doubtful | Home Equity
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	95	26
Doubtful | Consumer
Classes of the loan portfolio summarized by credit quality indicators:
Total loans, excluding PCI	0	0
Doubtful | Purchased credit impaired loans
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	330	5,469
Doubtful | Purchased credit impaired loans | Commercial and non-residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	328	5,116
Doubtful | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	209	4,860
Doubtful | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	73	21
Doubtful | Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	46	235
Doubtful | Purchased credit impaired loans | Residential real estate
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	0	121
Doubtful | Purchased credit impaired loans | Consumer
Classes of the loan portfolio summarized by credit quality indicators:
Total Loans	$ 2	$ 232