Loans and Allowance for Loan Losses - Summary of Loans by Major Class (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Dec. 31, 2019
Loans and Allowance for Loan Losses
Total loans held for investment	$ 1,280,615	$ 1,168,797
Commercial, financial, and agricultural
Loans and Allowance for Loan Losses
Total loans held for investment	296,323	199,022
SBA PPA loans, net	83,800
Residential real estate | Construction
Loans and Allowance for Loan Losses
Total loans held for investment	27,188	23,035
Residential real estate | Mortgages
Loans and Allowance for Loan Losses
Total loans held for investment	250,452	252,643
Commercial real estate | Construction
Loans and Allowance for Loan Losses
Total loans held for investment	85,009	84,998
Commercial real estate | Mortgages
Loans and Allowance for Loan Losses
Total loans held for investment	592,855	576,635
Installment and other consumer
Loans and Allowance for Loan Losses
Total loans held for investment	$ 28,788	$ 32,464