Allowance for Loan Losses (Details 6) - USD ($) $ in Thousands	Jun. 30, 2016	Dec. 31, 2015
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	$ 1,807,574	$ 1,769,790
Financing Receivable, Recorded Investment, Past Due	12,432	17,296
Financing Receivable, Recorded Investment, Current	1,795,142	1,752,494
Total loans	1,799,851	1,761,323
Loans not rated	1,799,851
Commercial & Industrial
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	486,594	478,989
Financing Receivable, Recorded Investment, Past Due	1,754	2,005
Financing Receivable, Recorded Investment, Current	484,840	476,984
Total loans	485,350	477,475
Farmland
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	115,273	106,860
Financing Receivable, Recorded Investment, Past Due	1,194	135
Financing Receivable, Recorded Investment, Current	114,079	106,725
Total loans	113,691	105,029
Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	203,986	209,068
Financing Receivable, Recorded Investment, Past Due	592	2,224
Financing Receivable, Recorded Investment, Current	203,394	206,844
Total loans	203,512	208,630
Agriculture
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	140,453	143,543
Financing Receivable, Recorded Investment, Past Due	963	427
Financing Receivable, Recorded Investment, Current	139,490	143,116
Total loans	139,109	141,824
All Other Commercial
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	141,475	111,541
Financing Receivable, Recorded Investment, Past Due	9	57
Financing Receivable, Recorded Investment, Current	141,466	111,484
Total loans	140,799	111,022
First Liens
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	280,636	293,725
Financing Receivable, Recorded Investment, Past Due	3,491	7,812
Financing Receivable, Recorded Investment, Current	277,145	285,913
Total loans	279,775	292,828
Home Equity
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	35,956	37,724
Financing Receivable, Recorded Investment, Past Due	211	222
Financing Receivable, Recorded Investment, Current	35,745	37,502
Total loans	35,905	37,662
Junior Liens
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	34,993	33,261
Financing Receivable, Recorded Investment, Past Due	514	385
Financing Receivable, Recorded Investment, Current	34,479	32,876
Total loans	34,907	33,175
Multifamily
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	71,883	70,735
Financing Receivable, Recorded Investment, Past Due	0	0
Financing Receivable, Recorded Investment, Current	71,883	70,735
Total loans	71,743	70,597
All Other Residential
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	7,772	10,210
Financing Receivable, Recorded Investment, Past Due	0	15
Financing Receivable, Recorded Investment, Current	7,772	10,195
Total loans	7,752	10,185
Motor Vehicle
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	265,110	251,843
Financing Receivable, Recorded Investment, Past Due	3,503	3,961
Financing Receivable, Recorded Investment, Current	261,607	247,882
Total loans	263,976	250,720
All Other Consumer
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	23,443	22,291
Financing Receivable, Recorded Investment, Past Due	201	53
Financing Receivable, Recorded Investment, Current	23,242	22,238
Total loans	23,332	22,176
Pass
Analysis of risk category of loans by class of loans
Total loans	1,140,243	1,107,466
Pass | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	433,878	417,880
Pass | Farmland
Analysis of risk category of loans by class of loans
Total loans	93,903	93,418
Pass | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	176,105	180,659
Pass | Agriculture
Analysis of risk category of loans by class of loans
Total loans	111,776	121,244
Pass | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	128,842	95,850
Pass | First Liens
Analysis of risk category of loans by class of loans
Total loans	93,910	96,146
Pass | Home Equity
Analysis of risk category of loans by class of loans
Total loans	10,125	11,701
Pass | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	7,690	7,493
Pass | Multifamily
Analysis of risk category of loans by class of loans
Total loans	70,130	68,972
Pass | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	522	886
Pass | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	10,563	10,287
Pass | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	2,799	2,930
Special Mention
Analysis of risk category of loans by class of loans
Total loans	64,975	56,638
Special Mention | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	19,378	20,422
Special Mention | Farmland
Analysis of risk category of loans by class of loans
Total loans	13,172	6,387
Special Mention | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	9,401	8,114
Special Mention | Agriculture
Analysis of risk category of loans by class of loans
Total loans	16,887	11,964
Special Mention | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	121	2,649
Special Mention | First Liens
Analysis of risk category of loans by class of loans
Total loans	3,669	4,594
Special Mention | Home Equity
Analysis of risk category of loans by class of loans
Total loans	213	387
Special Mention | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	241	86
Special Mention | Multifamily
Analysis of risk category of loans by class of loans
Total loans	1,574	1,602
Special Mention | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Special Mention | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	274	356
Special Mention | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	45	77
Substandard
Analysis of risk category of loans by class of loans
Total loans	82,717	87,604
Substandard | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	27,153	32,778
Substandard | Farmland
Analysis of risk category of loans by class of loans
Total loans	6,602	5,208
Substandard | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	18,006	19,857
Substandard | Agriculture
Analysis of risk category of loans by class of loans
Total loans	10,242	8,419
Substandard | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	10,995	10,887
Substandard | First Liens
Analysis of risk category of loans by class of loans
Total loans	7,607	8,598
Substandard | Home Equity
Analysis of risk category of loans by class of loans
Total loans	912	669
Substandard | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	542	505
Substandard | Multifamily
Analysis of risk category of loans by class of loans
Total loans	15	0
Substandard | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	23	24
Substandard | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	517	534
Substandard | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	103	125
Doubtful
Analysis of risk category of loans by class of loans
Total loans	1,233	1,666
Doubtful | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	470	757
Doubtful | Farmland
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | Agriculture
Analysis of risk category of loans by class of loans
Total loans	24	27
Doubtful | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	76	101
Doubtful | First Liens
Analysis of risk category of loans by class of loans
Total loans	603	699
Doubtful | Home Equity
Analysis of risk category of loans by class of loans
Total loans	9	10
Doubtful | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	27	58
Doubtful | Multifamily
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	10	0
Doubtful | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	14	14
Not Rated
Analysis of risk category of loans by class of loans
Total loans	510,683	507,949
Not Rated | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	4,471	5,638
Not Rated | Farmland
Analysis of risk category of loans by class of loans
Total loans	14	16
Not Rated | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Not Rated | Agriculture
Analysis of risk category of loans by class of loans
Total loans	180	170
Not Rated | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	765	1,535
Not Rated | First Liens
Analysis of risk category of loans by class of loans
Total loans	173,986	182,791
Not Rated | Home Equity
Analysis of risk category of loans by class of loans
Total loans	24,646	24,895
Not Rated | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	26,407	25,033
Not Rated | Multifamily
Analysis of risk category of loans by class of loans
Total loans	24	23
Not Rated | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	7,207	9,275
Not Rated | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	252,612	239,543
Not Rated | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	$ 20,371	$ 19,030