Loans - Schedule of Portfolio Loans, Purchased Credit Impaired Loans and Purchased Unimpaired Loans (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	$ 5,198,404	$ 4,825,214
Deferred costs	19,900	16,900
Real Estate | Construction and land development
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	325,113	443,568
Real Estate | Commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	2,378,971	2,132,066
Real Estate | Residential real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	1,507,863	1,324,377
Commercial and financial | Commercial and financial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	778,252	722,322
Consumer | Consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	208,205	202,881
Portfolio Loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	4,317,918	3,588,251
Portfolio Loans | Real Estate | Construction and land development
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	281,335	301,473
Portfolio Loans | Real Estate | Commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	1,834,811	1,437,989
Portfolio Loans | Real Estate | Residential real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	1,304,305	1,055,525
Portfolio Loans | Commercial and financial | Commercial and financial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	697,301	603,057
Portfolio Loans | Consumer | Consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	200,166	190,207
PCI Loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	12,666	14,434
PCI Loans | Real Estate | Construction and land development
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	160	151
PCI Loans | Real Estate | Commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	10,217	10,828
PCI Loans | Real Estate | Residential real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	1,710	2,718
PCI Loans | Commercial and financial | Commercial and financial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	579	737
PCI Loans | Consumer | Consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	0	0
PULs
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	867,820	1,222,529
PULs | Real Estate | Construction and land development
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	43,618	141,944
PULs | Real Estate | Commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	533,943	683,249
PULs | Real Estate | Residential real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	201,848	266,134
PULs | Commercial and financial | Commercial and financial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	80,372	118,528
PULs | Consumer | Consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans	$ 8,039	$ 12,674