Non-performing Loans and Impaired Loans - Schedule of TDRs by Loan Portfolio (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	$ 3,360	$ 2,006
Performing TDRs	2,115	3,354
Total	5,475	5,360
Commercial
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	2,412	1,081
Performing TDRs	139	1,484
Total	2,551	2,565
Commercial | Owner occupied real estate
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	629	629
Performing TDRs	139	139
Total	768	768
Commercial | Non-owner occupied real estate
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	361	374
Performing TDRs	0	0
Total	361	374
Commercial | Residential spec homes
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Commercial | Development & spec land
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Commercial | Commercial and industrial
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	1,422	78
Performing TDRs	0	1,345
Total	1,422	1,423
Real estate
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	733	708
Performing TDRs	1,638	1,561
Total	2,371	2,269
Real estate | Residential mortgage
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	733	708
Performing TDRs	1,638	1,561
Total	2,371	2,269
Real estate | Residential construction
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Real estate | Mortgage warehouse
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Consumer
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	215	217
Performing TDRs	338	309
Total	553	526
Consumer | Direct installment
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Consumer | Indirect installment
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	0	0
Performing TDRs	0	0
Total	0	0
Consumer | Home equity
Financing Receivable, Troubled Debt Restructuring [Line Items]
TDR loans	215	217
Performing TDRs	338	309
Total	$ 553	$ 526