Loans - Summary of Risk Category of Loans by Class of Loans (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Accounts Notes And Loans Receivable [Line Items]
Total loans	$ 2,196,934	$ 2,142,015
Real Estate | Construction and Land Development
Accounts Notes And Loans Receivable [Line Items]
Total loans	96,020	113,235
Real Estate | Commercial Real Estate
Accounts Notes And Loans Receivable [Line Items]
Total loans	793,268	758,721
Real Estate | Single-family Residential Mortgages
Accounts Notes And Loans Receivable [Line Items]
Total loans	957,254	881,249
Commercial | Commercial and Industrial
Accounts Notes And Loans Receivable [Line Items]
Total loans	274,586	304,310
Commercial | SBA
Accounts Notes And Loans Receivable [Line Items]
Total loans	74,985	84,500
Other
Accounts Notes And Loans Receivable [Line Items]
Total loans	821
Pass
Accounts Notes And Loans Receivable [Line Items]
Total loans	2,146,181	2,111,225
Pass | Real Estate | Construction and Land Development
Accounts Notes And Loans Receivable [Line Items]
Total loans	95,756	112,959
Pass | Real Estate | Commercial Real Estate
Accounts Notes And Loans Receivable [Line Items]
Total loans	767,603	743,123
Pass | Real Estate | Single-family Residential Mortgages
Accounts Notes And Loans Receivable [Line Items]
Total loans	955,327	880,860
Pass | Commercial | Commercial and Industrial
Accounts Notes And Loans Receivable [Line Items]
Total loans	265,178	295,226
Pass | Commercial | SBA
Accounts Notes And Loans Receivable [Line Items]
Total loans	61,496	79,057
Pass | Other
Accounts Notes And Loans Receivable [Line Items]
Total loans	821
Special Mention
Accounts Notes And Loans Receivable [Line Items]
Total loans	9,620	13,355
Special Mention | Real Estate | Commercial Real Estate
Accounts Notes And Loans Receivable [Line Items]
Total loans	5,353	7,069
Special Mention | Commercial | Commercial and Industrial
Accounts Notes And Loans Receivable [Line Items]
Total loans	4,078	6,286
Special Mention | Commercial | SBA
Accounts Notes And Loans Receivable [Line Items]
Total loans	189
Substandard
Accounts Notes And Loans Receivable [Line Items]
Total loans	27,915	14,154
Substandard | Real Estate | Commercial Real Estate
Accounts Notes And Loans Receivable [Line Items]
Total loans	18,115	6,496
Substandard | Real Estate | Single-family Residential Mortgages
Accounts Notes And Loans Receivable [Line Items]
Total loans	593	389
Substandard | Commercial | Commercial and Industrial
Accounts Notes And Loans Receivable [Line Items]
Total loans	5,330	2,798
Substandard | Commercial | SBA
Accounts Notes And Loans Receivable [Line Items]
Total loans	3,877	4,471
Impaired
Accounts Notes And Loans Receivable [Line Items]
Total loans	13,218	3,281
Impaired | Real Estate | Construction and Land Development
Accounts Notes And Loans Receivable [Line Items]
Total loans	264	276
Impaired | Real Estate | Commercial Real Estate
Accounts Notes And Loans Receivable [Line Items]
Total loans	2,197	2,033
Impaired | Real Estate | Single-family Residential Mortgages
Accounts Notes And Loans Receivable [Line Items]
Total loans	1,334
Impaired | Commercial | SBA
Accounts Notes And Loans Receivable [Line Items]
Total loans	$ 9,423	$ 972