Allowance for Loan Losses (Details 6) - USD ($) $ in Thousands	Sep. 30, 2016	Dec. 31, 2015
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	$ 1,827,474	$ 1,769,790
Financing Receivable, Recorded Investment, Past Due	12,289	17,296
Financing Receivable, Recorded Investment, Current	1,815,185	1,752,494
Total loans	1,818,315	1,761,323
Loans not rated	1,818,315
Commercial & Industrial
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	470,168	478,989
Financing Receivable, Recorded Investment, Past Due	1,770	2,005
Financing Receivable, Recorded Investment, Current	468,398	476,984
Total loans	468,838	477,475
Farmland
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	112,006	106,860
Financing Receivable, Recorded Investment, Past Due	68	135
Financing Receivable, Recorded Investment, Current	111,938	106,725
Total loans	109,882	105,029
Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	197,314	209,068
Financing Receivable, Recorded Investment, Past Due	195	2,224
Financing Receivable, Recorded Investment, Current	197,119	206,844
Total loans	196,845	208,630
Agriculture
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	145,898	143,543
Financing Receivable, Recorded Investment, Past Due	1,327	427
Financing Receivable, Recorded Investment, Current	144,571	143,116
Total loans	143,842	141,824
All Other Commercial
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	164,550	111,541
Financing Receivable, Recorded Investment, Past Due	139	57
Financing Receivable, Recorded Investment, Current	164,411	111,484
Total loans	163,722	111,022
First Liens
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	278,420	293,725
Financing Receivable, Recorded Investment, Past Due	3,686	7,812
Financing Receivable, Recorded Investment, Current	274,734	285,913
Total loans	277,591	292,828
Home Equity
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	36,703	37,724
Financing Receivable, Recorded Investment, Past Due	276	222
Financing Receivable, Recorded Investment, Current	36,427	37,502
Total loans	36,648	37,662
Junior Liens
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	35,856	33,261
Financing Receivable, Recorded Investment, Past Due	569	385
Financing Receivable, Recorded Investment, Current	35,287	32,876
Total loans	35,774	33,175
Multifamily
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	70,517	70,735
Financing Receivable, Recorded Investment, Past Due	0	0
Financing Receivable, Recorded Investment, Current	70,517	70,735
Total loans	70,381	70,597
All Other Residential
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	9,977	10,210
Financing Receivable, Recorded Investment, Past Due	0	15
Financing Receivable, Recorded Investment, Current	9,977	10,195
Total loans	9,952	10,185
Motor Vehicle
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	281,652	251,843
Financing Receivable, Recorded Investment, Past Due	4,164	3,961
Financing Receivable, Recorded Investment, Current	277,488	247,882
Total loans	280,532	250,720
All Other Consumer
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	24,413	22,291
Financing Receivable, Recorded Investment, Past Due	95	53
Financing Receivable, Recorded Investment, Current	24,318	22,238
Total loans	24,308	22,176
Pass
Analysis of risk category of loans by class of loans
Total loans	1,066,136	1,107,466
Pass | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	419,984	417,880
Pass | Farmland
Analysis of risk category of loans by class of loans
Total loans	91,237	93,418
Pass | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	172,972	180,659
Pass | Agriculture
Analysis of risk category of loans by class of loans
Total loans	117,386	121,244
Pass | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	150,953	95,850
Pass | First Liens
Analysis of risk category of loans by class of loans
Total loans	43,308	96,146
Pass | Home Equity
Analysis of risk category of loans by class of loans
Total loans	357	11,701
Pass | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	1,888	7,493
Pass | Multifamily
Analysis of risk category of loans by class of loans
Total loans	68,051	68,972
Pass | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	0	886
Pass | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	0	10,287
Pass | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	0	2,930
Special Mention
Analysis of risk category of loans by class of loans
Total loans	54,516	56,638
Special Mention | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	17,988	20,422
Special Mention | Farmland
Analysis of risk category of loans by class of loans
Total loans	12,274	6,387
Special Mention | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	6,523	8,114
Special Mention | Agriculture
Analysis of risk category of loans by class of loans
Total loans	13,587	11,964
Special Mention | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	661	2,649
Special Mention | First Liens
Analysis of risk category of loans by class of loans
Total loans	1,280	4,594
Special Mention | Home Equity
Analysis of risk category of loans by class of loans
Total loans	0	387
Special Mention | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	86	86
Special Mention | Multifamily
Analysis of risk category of loans by class of loans
Total loans	2,117	1,602
Special Mention | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Special Mention | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	0	356
Special Mention | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	0	77
Substandard
Analysis of risk category of loans by class of loans
Total loans	77,083	87,604
Substandard | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	23,935	32,778
Substandard | Farmland
Analysis of risk category of loans by class of loans
Total loans	6,138	5,208
Substandard | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	17,350	19,857
Substandard | Agriculture
Analysis of risk category of loans by class of loans
Total loans	12,526	8,419
Substandard | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	10,367	10,887
Substandard | First Liens
Analysis of risk category of loans by class of loans
Total loans	5,746	8,598
Substandard | Home Equity
Analysis of risk category of loans by class of loans
Total loans	183	669
Substandard | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	432	505
Substandard | Multifamily
Analysis of risk category of loans by class of loans
Total loans	15	0
Substandard | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	22	24
Substandard | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	344	534
Substandard | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	25	125
Doubtful
Analysis of risk category of loans by class of loans
Total loans	599	1,666
Doubtful | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	450	757
Doubtful | Farmland
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | Agriculture
Analysis of risk category of loans by class of loans
Total loans	24	27
Doubtful | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	76	101
Doubtful | First Liens
Analysis of risk category of loans by class of loans
Total loans	23	699
Doubtful | Home Equity
Analysis of risk category of loans by class of loans
Total loans	0	10
Doubtful | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	26	58
Doubtful | Multifamily
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	0	14
Not Rated
Analysis of risk category of loans by class of loans
Total loans	619,981	507,949
Not Rated | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	6,481	5,638
Not Rated | Farmland
Analysis of risk category of loans by class of loans
Total loans	233	16
Not Rated | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Not Rated | Agriculture
Analysis of risk category of loans by class of loans
Total loans	319	170
Not Rated | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	1,665	1,535
Not Rated | First Liens
Analysis of risk category of loans by class of loans
Total loans	227,234	182,791
Not Rated | Home Equity
Analysis of risk category of loans by class of loans
Total loans	36,108	24,895
Not Rated | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	33,342	25,033
Not Rated | Multifamily
Analysis of risk category of loans by class of loans
Total loans	198	23
Not Rated | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	9,930	9,275
Not Rated | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	280,188	239,543
Not Rated | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	$ 24,283	$ 19,030