Loans and Allowance for Loan Losses - Aging (Details) - USD ($) $ in Thousands	Jun. 30, 2021	Dec. 31, 2020	Jun. 30, 2020
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	$ 1,676,729	$ 1,415,362	$ 1,448,326
Total Loans	1,699,871	1,454,801
Non-Accrual	15,501	13,713
90 Plus Days Still Accruing	0	0
SBA PPP
Aging categories of performing loans and nonaccrual loans
Total Loans	143,000
Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	1,385,849	1,141,114	1,127,792
Non-Accrual	8,811	12,079
90 Plus Days Still Accruing	0	0
Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	591,561	523,891
Non-Accrual	6,778	8,601
90 Plus Days Still Accruing	0	0
Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	486,980	423,122
Non-Accrual	506	944
90 Plus Days Still Accruing	0	0
Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	100,005	112,126
Non-Accrual	1,527	2,534
90 Plus Days Still Accruing	0	0
Commercial and non-residential real estate | SBA PPP
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	207,303	81,975
Non-Accrual	0	0
90 Plus Days Still Accruing	0	0
Residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	255,935	240,264	279,626
Non-Accrual	6,592	1,534
90 Plus Days Still Accruing	0	0
Home Equity
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	24,833	30,828	37,383
Non-Accrual	95	95
90 Plus Days Still Accruing	0	0
Consumer
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	10,112	3,156	$ 3,525
Non-Accrual	3	5
90 Plus Days Still Accruing	0	0
Purchased credit impaired loans
Aging categories of performing loans and nonaccrual loans
Total Loans	23,142	39,439
Purchased credit impaired loans | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	13,860	21,008
Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total Loans	11,226	17,604
Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	2,259	1,269
Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total Loans	375	2,135
Purchased credit impaired loans | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	8,851	16,943
Purchased credit impaired loans | Consumer
Aging categories of performing loans and nonaccrual loans
Total Loans	431	1,488
Financial Asset, Not Past Due
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	1,666,070	1,404,748
Financial Asset, Not Past Due | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	1,382,565	1,135,803
Financial Asset, Not Past Due | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	590,008	521,799
Financial Asset, Not Past Due | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	486,692	422,343
Financial Asset, Not Past Due | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	98,562	109,686
Financial Asset, Not Past Due | Commercial and non-residential real estate | SBA PPP
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	207,303	81,975
Financial Asset, Not Past Due | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	248,736	235,420
Financial Asset, Not Past Due | Home Equity
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	24,660	30,369
Financial Asset, Not Past Due | Consumer
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	10,109	3,156
Financial Asset, Not Past Due | Purchased credit impaired loans
Aging categories of performing loans and nonaccrual loans
Total Loans	13,652	34,515
Financial Asset, Not Past Due | Purchased credit impaired loans | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	6,951	19,556
Financial Asset, Not Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total Loans	6,400	16,264
Financial Asset, Not Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	551	1,157
Financial Asset, Not Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total Loans	0	2,135
Financial Asset, Not Past Due | Purchased credit impaired loans | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	6,272	13,714
Financial Asset, Not Past Due | Purchased credit impaired loans | Consumer
Aging categories of performing loans and nonaccrual loans
Total Loans	429	1,245
Financing Receivables, 30 to 59 Days Past Due
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	1,638	3,421
Financing Receivables, 30 to 59 Days Past Due | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	758	1,074
Financing Receivables, 30 to 59 Days Past Due | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	626	1,040
Financing Receivables, 30 to 59 Days Past Due | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	132	34
Financing Receivables, 30 to 59 Days Past Due | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	0
Financing Receivables, 30 to 59 Days Past Due | Commercial and non-residential real estate | SBA PPP
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	0
Financing Receivables, 30 to 59 Days Past Due | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	829	2,058
Financing Receivables, 30 to 59 Days Past Due | Home Equity
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	48	289
Financing Receivables, 30 to 59 Days Past Due | Consumer
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	3	0
Financing Receivables, 30 to 59 Days Past Due | Purchased credit impaired loans
Aging categories of performing loans and nonaccrual loans
Total Loans	585	784
Financing Receivables, 30 to 59 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	373	71
Financing Receivables, 30 to 59 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total Loans	373	71
Financing Receivables, 30 to 59 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	0	0
Financing Receivables, 30 to 59 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total Loans	0	0
Financing Receivables, 30 to 59 Days Past Due | Purchased credit impaired loans | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	212	710
Financing Receivables, 30 to 59 Days Past Due | Purchased credit impaired loans | Consumer
Aging categories of performing loans and nonaccrual loans
Total Loans	0	3
Financing Receivables, 60 to 89 Days Past Due
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	266	2,289
Financing Receivables, 60 to 89 Days Past Due | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	245
Financing Receivables, 60 to 89 Days Past Due | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	33
Financing Receivables, 60 to 89 Days Past Due | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	212
Financing Receivables, 60 to 89 Days Past Due | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	0
Financing Receivables, 60 to 89 Days Past Due | Commercial and non-residential real estate | SBA PPP
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	0
Financing Receivables, 60 to 89 Days Past Due | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	236	1,969
Financing Receivables, 60 to 89 Days Past Due | Home Equity
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	30	75
Financing Receivables, 60 to 89 Days Past Due | Consumer
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	0
Financing Receivables, 60 to 89 Days Past Due | Purchased credit impaired loans
Aging categories of performing loans and nonaccrual loans
Total Loans	355	211
Financing Receivables, 60 to 89 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	284	65
Financing Receivables, 60 to 89 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total Loans	284	65
Financing Receivables, 60 to 89 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	0	0
Financing Receivables, 60 to 89 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total Loans	0	0
Financing Receivables, 60 to 89 Days Past Due | Purchased credit impaired loans | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	71	145
Financing Receivables, 60 to 89 Days Past Due | Purchased credit impaired loans | Consumer
Aging categories of performing loans and nonaccrual loans
Total Loans	0	1
Financing Receivables, Equal to Greater than 90 Days Past Due
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	8,755	4,904
Financing Receivables, Equal to Greater than 90 Days Past Due | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	2,526	3,992
Financing Receivables, Equal to Greater than 90 Days Past Due | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	927	1,019
Financing Receivables, Equal to Greater than 90 Days Past Due | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	156	533
Financing Receivables, Equal to Greater than 90 Days Past Due | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	1,443	2,440
Financing Receivables, Equal to Greater than 90 Days Past Due | Commercial and non-residential real estate | SBA PPP
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	0
Financing Receivables, Equal to Greater than 90 Days Past Due | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	6,134	817
Financing Receivables, Equal to Greater than 90 Days Past Due | Home Equity
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	95	95
Financing Receivables, Equal to Greater than 90 Days Past Due | Consumer
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	0
Financing Receivables, Equal to Greater than 90 Days Past Due | Purchased credit impaired loans
Aging categories of performing loans and nonaccrual loans
Total Loans	8,550	3,929
Financing Receivables, Equal to Greater than 90 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	6,252	1,316
Financing Receivables, Equal to Greater than 90 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total Loans	4,169	1,204
Financing Receivables, Equal to Greater than 90 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	1,708	112
Financing Receivables, Equal to Greater than 90 Days Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total Loans	375	0
Financing Receivables, Equal to Greater than 90 Days Past Due | Purchased credit impaired loans | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	2,296	2,374
Financing Receivables, Equal to Greater than 90 Days Past Due | Purchased credit impaired loans | Consumer
Aging categories of performing loans and nonaccrual loans
Total Loans	2	239
Financial Asset, Past Due
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	10,659	10,614
Financial Asset, Past Due | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	3,284	5,311
Financial Asset, Past Due | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	1,553	2,092
Financial Asset, Past Due | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	288	779
Financial Asset, Past Due | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	1,443	2,440
Financial Asset, Past Due | Commercial and non-residential real estate | SBA PPP
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	0	0
Financial Asset, Past Due | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	7,199	4,844
Financial Asset, Past Due | Home Equity
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	173	459
Financial Asset, Past Due | Consumer
Aging categories of performing loans and nonaccrual loans
Total loans, excluding PCI	3	0
Financial Asset, Past Due | Purchased credit impaired loans
Aging categories of performing loans and nonaccrual loans
Total Loans	9,490	4,924
Financial Asset, Past Due | Purchased credit impaired loans | Commercial and non-residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	6,909	1,452
Financial Asset, Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial business
Aging categories of performing loans and nonaccrual loans
Total Loans	4,826	1,340
Financial Asset, Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Commercial real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	1,708	112
Financial Asset, Past Due | Purchased credit impaired loans | Commercial and non-residential real estate | Acquisition and development
Aging categories of performing loans and nonaccrual loans
Total Loans	375	0
Financial Asset, Past Due | Purchased credit impaired loans | Residential real estate
Aging categories of performing loans and nonaccrual loans
Total Loans	2,579	3,229
Financial Asset, Past Due | Purchased credit impaired loans | Consumer
Aging categories of performing loans and nonaccrual loans
Total Loans	$ 2	$ 243