Non-performing Loans and Impaired Loans - Non-accrual, Loans Past Due Over 90 Days Still on Accrual, and Troubled Debt Restructured ("TDRs") by Class of Loans (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Dec. 31, 2019
Financing Receivable, Past Due [Line Items]
Non-accrual	$ 22,451	$ 15,679
Loans Past Due Over 90 Days Still Accruing	123	146
TDR loans	3,443	2,006
Performing TDRs	2,039	3,354
Total Non-performing Loans	28,056	21,185
Non-accrual with no Allowance for Credit Losses	21,500	15,909
Commercial
Financing Receivable, Past Due [Line Items]
Non-accrual	11,908	4,782
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	2,163	1,081
Performing TDRs	167	1,484
Total Non-performing Loans	14,238	7,347
Non-accrual with no Allowance for Credit Losses	9,677	4,087
Commercial | Owner occupied real estate
Financing Receivable, Past Due [Line Items]
Non-accrual	8,547	2,424
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	629	629
Performing TDRs	167	139
Total Non-performing Loans	9,343	3,192
Non-accrual with no Allowance for Credit Losses	6,158	2,563
Commercial | Non-owner occupied real estate
Financing Receivable, Past Due [Line Items]
Non-accrual	1,242	682
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	350	374
Performing TDRs	0	0
Total Non-performing Loans	1,592	1,056
Non-accrual with no Allowance for Credit Losses	1,086	937
Commercial | Residential spec homes
Financing Receivable, Past Due [Line Items]
Non-accrual	0	0
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	0	0
Non-accrual with no Allowance for Credit Losses	0	0
Commercial | Development & spec land
Financing Receivable, Past Due [Line Items]
Non-accrual	70	73
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	70	73
Non-accrual with no Allowance for Credit Losses	70	73
Commercial | Commercial and industrial
Financing Receivable, Past Due [Line Items]
Non-accrual	2,049	1,603
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	1,184	78
Performing TDRs	0	1,345
Total Non-performing Loans	3,233	3,026
Non-accrual with no Allowance for Credit Losses	2,363	514
Real estate
Financing Receivable, Past Due [Line Items]
Non-accrual	7,354	7,614
Loans Past Due Over 90 Days Still Accruing	0	1
TDR loans	1,054	708
Performing TDRs	1,537	1,561
Total Non-performing Loans	9,945	9,884
Non-accrual with no Allowance for Credit Losses	8,408	8,322
Real estate | Residential mortgage
Financing Receivable, Past Due [Line Items]
Non-accrual	7,354	7,614
Loans Past Due Over 90 Days Still Accruing	0	1
TDR loans	1,054	708
Performing TDRs	1,537	1,561
Total Non-performing Loans	9,945	9,884
Non-accrual with no Allowance for Credit Losses	8,408	8,322
Real estate | Residential construction
Financing Receivable, Past Due [Line Items]
Non-accrual	0	0
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	0	0
Non-accrual with no Allowance for Credit Losses	0	0
Real estate | Mortgage warehouse
Financing Receivable, Past Due [Line Items]
Non-accrual	0	0
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	0	0
Non-accrual with no Allowance for Credit Losses	0	0
Consumer
Financing Receivable, Past Due [Line Items]
Non-accrual	3,189	3,283
Loans Past Due Over 90 Days Still Accruing	123	145
TDR loans	226	217
Performing TDRs	335	309
Total Non-performing Loans	3,873	3,954
Non-accrual with no Allowance for Credit Losses	3,415	3,500
Consumer | Direct installment
Financing Receivable, Past Due [Line Items]
Non-accrual	27	30
Loans Past Due Over 90 Days Still Accruing	40	5
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	67	35
Non-accrual with no Allowance for Credit Losses	27	30
Consumer | Indirect installment
Financing Receivable, Past Due [Line Items]
Non-accrual	1,237	1,234
Loans Past Due Over 90 Days Still Accruing	83	135
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	1,320	1,369
Non-accrual with no Allowance for Credit Losses	1,237	1,234
Consumer | Home equity
Financing Receivable, Past Due [Line Items]
Non-accrual	1,925	2,019
Loans Past Due Over 90 Days Still Accruing	0	5
TDR loans	226	217
Performing TDRs	335	309
Total Non-performing Loans	2,486	2,550
Non-accrual with no Allowance for Credit Losses	$ 2,151	$ 2,236