Loans and Leases - Credit Quality Classifications (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	$ 1,762,565	$ 1,731,928
Real Estate Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	1,402,114	1,453,930
Real Estate Sector [Member] | 1-4 Family Residential Construction [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	105,979	105,676
Real Estate Sector [Member] | Other construction/land [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	91,413	109,023
Real Estate Sector [Member] | 1-4 Family - Closed-End [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	200,181	236,825
Real Estate Sector [Member] | Equity Lines [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	49,599	56,320
Real Estate Sector [Member] | Multi-Family Residential [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	54,457	54,877
Real Estate Sector [Member] | Commercial Real Estate Owner Occupied [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	343,883	301,324
Real Estate Sector [Member] | Commercial Real Estate Non Owner Occupied [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	412,569	438,344
Real Estate Sector [Member] | Farmland [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	144,033	151,541
Agricultural Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	48,036	49,103
Commercial and Industrial Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	115,532	128,220
Mortgage Warehouse Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	189,103	91,813
Consumer Loans Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	7,780	8,862
Pass [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	1,719,616	1,677,847
Pass [Member] | Real Estate Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	1,374,870	1,419,253
Pass [Member] | Real Estate Sector [Member] | 1-4 Family Residential Construction [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	105,979	105,676
Pass [Member] | Real Estate Sector [Member] | Other construction/land [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	90,761	108,304
Pass [Member] | Real Estate Sector [Member] | 1-4 Family - Closed-End [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	194,572	230,022
Pass [Member] | Real Estate Sector [Member] | Equity Lines [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	43,111	49,346
Pass [Member] | Real Estate Sector [Member] | Multi-Family Residential [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	54,104	54,504
Pass [Member] | Real Estate Sector [Member] | Commercial Real Estate Owner Occupied [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	334,460	292,886
Pass [Member] | Real Estate Sector [Member] | Commercial Real Estate Non Owner Occupied [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	409,289	429,835
Pass [Member] | Real Estate Sector [Member] | Farmland [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	142,594	148,680
Pass [Member] | Agricultural Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	47,814	48,517
Pass [Member] | Commercial and Industrial Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	100,584	110,413
Pass [Member] | Mortgage Warehouse Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	189,103	91,813
Pass [Member] | Consumer Loans Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	7,245	7,851
Special Mention [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	24,452	28,698
Special Mention [Member] | Real Estate Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	10,735	12,281
Special Mention [Member] | Real Estate Sector [Member] | 1-4 Family Residential Construction [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	0	0
Special Mention [Member] | Real Estate Sector [Member] | Other construction/land [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	98	231
Special Mention [Member] | Real Estate Sector [Member] | 1-4 Family - Closed-End [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	2,425	1,861
Special Mention [Member] | Real Estate Sector [Member] | Equity Lines [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	1,995	2,194
Special Mention [Member] | Real Estate Sector [Member] | Multi-Family Residential [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	0	0
Special Mention [Member] | Real Estate Sector [Member] | Commercial Real Estate Owner Occupied [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	4,005	4,192
Special Mention [Member] | Real Estate Sector [Member] | Commercial Real Estate Non Owner Occupied [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	1,164	2,730
Special Mention [Member] | Real Estate Sector [Member] | Farmland [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	1,048	1,073
Special Mention [Member] | Agricultural Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	217	580
Special Mention [Member] | Commercial and Industrial Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	13,415	15,686
Special Mention [Member] | Mortgage Warehouse Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	0	0
Special Mention [Member] | Consumer Loans Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	85	151
Substandard [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	4,344	9,311
Substandard [Member] | Real Estate Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	3,763	8,895
Substandard [Member] | Real Estate Sector [Member] | 1-4 Family Residential Construction [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	0	0
Substandard [Member] | Real Estate Sector [Member] | Other construction/land [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	0	0
Substandard [Member] | Real Estate Sector [Member] | 1-4 Family - Closed-End [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	164	1,310
Substandard [Member] | Real Estate Sector [Member] | Equity Lines [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	72	64
Substandard [Member] | Real Estate Sector [Member] | Multi-Family Residential [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	0	0
Substandard [Member] | Real Estate Sector [Member] | Commercial Real Estate Owner Occupied [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	3,384	3,021
Substandard [Member] | Real Estate Sector [Member] | Commercial Real Estate Non Owner Occupied [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	11	4,354
Substandard [Member] | Real Estate Sector [Member] | Farmland [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	132	146
Substandard [Member] | Agricultural Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	0	0
Substandard [Member] | Commercial and Industrial Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	556	377
Substandard [Member] | Mortgage Warehouse Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	0	0
Substandard [Member] | Consumer Loans Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	25	39
Impaired [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	14,153	16,072
Impaired [Member] | Real Estate Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	12,746	13,501
Impaired [Member] | Real Estate Sector [Member] | 1-4 Family Residential Construction [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	0	0
Impaired [Member] | Real Estate Sector [Member] | Other construction/land [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	554	488
Impaired [Member] | Real Estate Sector [Member] | 1-4 Family - Closed-End [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	3,020	3,632
Impaired [Member] | Real Estate Sector [Member] | Equity Lines [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	4,421	4,716
Impaired [Member] | Real Estate Sector [Member] | Multi-Family Residential [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	353	373
Impaired [Member] | Real Estate Sector [Member] | Commercial Real Estate Owner Occupied [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	2,034	1,225
Impaired [Member] | Real Estate Sector [Member] | Commercial Real Estate Non Owner Occupied [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	2,105	1,425
Impaired [Member] | Real Estate Sector [Member] | Farmland [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	259	1,642
Impaired [Member] | Agricultural Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	5	6
Impaired [Member] | Commercial and Industrial Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	977	1,744
Impaired [Member] | Mortgage Warehouse Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	0	0
Impaired [Member] | Consumer Loans Sector [Member]
Financing Receivable Recorded Investment [Line Items]
Total gross loans and leases	$ 425	$ 821