Non-performing Loans and Impaired Loans - Non-accrual, Loans Past Due Over 90 Days Still on Accrual, and Troubled Debt Restructured ("TDRs") by Class of Loans (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Financing Receivable, Past Due [Line Items]
Non-accrual	$ 18,281	$ 15,679
Loans Past Due Over 90 Days Still Accruing	246	146
TDR loans	3,360	2,006
Performing TDRs	2,115	3,354
Total Non-performing Loans	24,002	21,185
Non-accrual with no Allowance for Credit Losses	8,124	15,909
Commercial
Financing Receivable, Past Due [Line Items]
Non-accrual	7,017	4,782
Loans Past Due Over 90 Days Still Accruing	11	0
TDR loans	2,412	1,081
Performing TDRs	139	1,484
Total Non-performing Loans	9,579	7,347
Non-accrual with no Allowance for Credit Losses	4,900	4,087
Commercial | Owner occupied real estate
Financing Receivable, Past Due [Line Items]
Non-accrual	5,512	2,424
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	629	629
Performing TDRs	139	139
Total Non-performing Loans	6,280	3,192
Non-accrual with no Allowance for Credit Losses	3,123	2,563
Commercial | Non-owner occupied real estate
Financing Receivable, Past Due [Line Items]
Non-accrual	641	682
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	361	374
Performing TDRs	0	0
Total Non-performing Loans	1,002	1,056
Non-accrual with no Allowance for Credit Losses	888	937
Commercial | Residential spec homes
Financing Receivable, Past Due [Line Items]
Non-accrual	0	0
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	0	0
Non-accrual with no Allowance for Credit Losses	0	0
Commercial | Development & spec land
Financing Receivable, Past Due [Line Items]
Non-accrual	73	73
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	73	73
Non-accrual with no Allowance for Credit Losses	73	73
Commercial | Commercial and industrial
Financing Receivable, Past Due [Line Items]
Non-accrual	791	1,603
Loans Past Due Over 90 Days Still Accruing	11	0
TDR loans	1,422	78
Performing TDRs	0	1,345
Total Non-performing Loans	2,224	3,026
Non-accrual with no Allowance for Credit Losses	816	514
Real estate
Financing Receivable, Past Due [Line Items]
Non-accrual	8,040	7,614
Loans Past Due Over 90 Days Still Accruing	0	1
TDR loans	733	708
Performing TDRs	1,638	1,561
Total Non-performing Loans	10,411	9,884
Non-accrual with no Allowance for Credit Losses	0	8,322
Real estate | Residential mortgage
Financing Receivable, Past Due [Line Items]
Non-accrual	8,040	7,614
Loans Past Due Over 90 Days Still Accruing	0	1
TDR loans	733	708
Performing TDRs	1,638	1,561
Total Non-performing Loans	10,411	9,884
Non-accrual with no Allowance for Credit Losses	0	8,322
Real estate | Residential construction
Financing Receivable, Past Due [Line Items]
Non-accrual	0	0
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	0	0
Non-accrual with no Allowance for Credit Losses	0	0
Real estate | Mortgage warehouse
Financing Receivable, Past Due [Line Items]
Non-accrual	0	0
Loans Past Due Over 90 Days Still Accruing	0	0
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	0	0
Non-accrual with no Allowance for Credit Losses	0	0
Consumer
Financing Receivable, Past Due [Line Items]
Non-accrual	3,224	3,283
Loans Past Due Over 90 Days Still Accruing	235	145
TDR loans	215	217
Performing TDRs	338	309
Total Non-performing Loans	4,012	3,954
Non-accrual with no Allowance for Credit Losses	3,224	3,500
Consumer | Direct installment
Financing Receivable, Past Due [Line Items]
Non-accrual	18	30
Loans Past Due Over 90 Days Still Accruing	0	5
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	18	35
Non-accrual with no Allowance for Credit Losses	18	30
Consumer | Indirect installment
Financing Receivable, Past Due [Line Items]
Non-accrual	1,168	1,234
Loans Past Due Over 90 Days Still Accruing	196	135
TDR loans	0	0
Performing TDRs	0	0
Total Non-performing Loans	1,364	1,369
Non-accrual with no Allowance for Credit Losses	1,168	1,234
Consumer | Home equity
Financing Receivable, Past Due [Line Items]
Non-accrual	2,038	2,019
Loans Past Due Over 90 Days Still Accruing	39	5
TDR loans	215	217
Performing TDRs	338	309
Total Non-performing Loans	2,630	2,550
Non-accrual with no Allowance for Credit Losses	$ 2,038	$ 2,236