Allowance for Loan Losses (Details 6) - USD ($) $ in Thousands	Sep. 30, 2015	Dec. 31, 2014
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	$ 1,772,988	$ 1,788,825
Financing Receivable, Recorded Investment, Past Due	12,986	20,409
Financing Receivable, Recorded Investment, Current	1,760,002	1,768,416
Total loans	1,764,337	1,780,350
Commercial & Industrial
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	476,886	455,585
Financing Receivable, Recorded Investment, Past Due	2,336	4,036
Financing Receivable, Recorded Investment, Current	474,550	451,549
Total loans	475,443	454,160
Farmland
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	104,351	95,452
Financing Receivable, Recorded Investment, Past Due	592	0
Financing Receivable, Recorded Investment, Current	103,759	95,452
Total loans	102,450	93,839
Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	212,275	234,238
Financing Receivable, Recorded Investment, Past Due	478	1,798
Financing Receivable, Recorded Investment, Current	211,797	232,440
Total loans	211,859	233,760
Agriculture
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	131,780	149,865
Financing Receivable, Recorded Investment, Past Due	1,289	766
Financing Receivable, Recorded Investment, Current	130,491	149,099
Total loans	130,083	148,102
All Other Commercial
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	121,542	115,269
Financing Receivable, Recorded Investment, Past Due	202	255
Financing Receivable, Recorded Investment, Current	121,340	115,014
Total loans	120,842	114,661
First Liens
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	302,567	316,564
Financing Receivable, Recorded Investment, Past Due	3,619	8,496
Financing Receivable, Recorded Investment, Current	298,948	308,068
Total loans	301,606	315,559
Home Equity
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	38,213	40,527
Financing Receivable, Recorded Investment, Past Due	376	484
Financing Receivable, Recorded Investment, Current	37,837	40,043
Total loans	38,156	40,463
Junior Liens
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	31,182	32,057
Financing Receivable, Recorded Investment, Past Due	580	570
Financing Receivable, Recorded Investment, Current	30,602	31,487
Total loans	31,100	31,962
Multifamily
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	71,916	72,310
Financing Receivable, Recorded Investment, Past Due	0	0
Financing Receivable, Recorded Investment, Current	71,916	72,310
Total loans	71,744	72,133
All Other Residential
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	8,840	9,078
Financing Receivable, Recorded Investment, Past Due	0	117
Financing Receivable, Recorded Investment, Current	8,840	8,961
Total loans	8,819	9,055
Motor Vehicle
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	251,084	246,169
Financing Receivable, Recorded Investment, Past Due	3,365	3,763
Financing Receivable, Recorded Investment, Current	247,719	242,406
Total loans	249,996	245,063
All Other Consumer
Analysis of risk category of loans by class of loans
Financing Receivable Recorded Investment	22,352	21,711
Financing Receivable, Recorded Investment, Past Due	149	124
Financing Receivable, Recorded Investment, Current	22,203	21,587
Total loans	22,239	21,593
Pass
Analysis of risk category of loans by class of loans
Total loans	1,100,446	1,116,963
Pass | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	408,039	393,449
Pass | Farmland
Analysis of risk category of loans by class of loans
Total loans	90,255	85,772
Pass | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	184,252	186,346
Pass | Agriculture
Analysis of risk category of loans by class of loans
Total loans	111,296	138,713
Pass | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	105,584	101,942
Pass | First Liens
Analysis of risk category of loans by class of loans
Total loans	98,630	104,854
Pass | Home Equity
Analysis of risk category of loans by class of loans
Total loans	11,097	12,592
Pass | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	7,578	8,112
Pass | Multifamily
Analysis of risk category of loans by class of loans
Total loans	69,077	69,080
Pass | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	902	1,799
Pass | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	10,555	11,135
Pass | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	3,181	3,169
Special Mention
Analysis of risk category of loans by class of loans
Total loans	63,737	79,040
Special Mention | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	28,331	29,081
Special Mention | Farmland
Analysis of risk category of loans by class of loans
Total loans	7,354	7,618
Special Mention | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	8,191	21,765
Special Mention | Agriculture
Analysis of risk category of loans by class of loans
Total loans	9,804	7,399
Special Mention | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	2,691	4,356
Special Mention | First Liens
Analysis of risk category of loans by class of loans
Total loans	4,591	5,929
Special Mention | Home Equity
Analysis of risk category of loans by class of loans
Total loans	453	375
Special Mention | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	119	173
Special Mention | Multifamily
Analysis of risk category of loans by class of loans
Total loans	1,616	1,801
Special Mention | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Special Mention | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	498	402
Special Mention | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	89	141
Substandard
Analysis of risk category of loans by class of loans
Total loans	87,502	70,119
Substandard | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	31,171	24,013
Substandard | Farmland
Analysis of risk category of loans by class of loans
Total loans	4,825	436
Substandard | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	19,380	25,613
Substandard | Agriculture
Analysis of risk category of loans by class of loans
Total loans	8,790	1,746
Substandard | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	11,193	7,055
Substandard | First Liens
Analysis of risk category of loans by class of loans
Total loans	8,633	7,733
Substandard | Home Equity
Analysis of risk category of loans by class of loans
Total loans	1,348	1,374
Substandard | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	482	561
Substandard | Multifamily
Analysis of risk category of loans by class of loans
Total loans	1,026	1,249
Substandard | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	25	28
Substandard | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	508	224
Substandard | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	121	87
Doubtful
Analysis of risk category of loans by class of loans
Total loans	2,262	4,271
Doubtful | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	1,295	2,900
Doubtful | Farmland
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	36	36
Doubtful | Agriculture
Analysis of risk category of loans by class of loans
Total loans	27	177
Doubtful | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	101	33
Doubtful | First Liens
Analysis of risk category of loans by class of loans
Total loans	718	1,035
Doubtful | Home Equity
Analysis of risk category of loans by class of loans
Total loans	11	6
Doubtful | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	59	63
Doubtful | Multifamily
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	0	0
Doubtful | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	15	21
Not Rated
Analysis of risk category of loans by class of loans
Total loans	510,390	509,957
Not Rated | Commercial & Industrial
Analysis of risk category of loans by class of loans
Total loans	6,607	4,717
Not Rated | Farmland
Analysis of risk category of loans by class of loans
Total loans	16	13
Not Rated | Non Farm, Non Residential
Analysis of risk category of loans by class of loans
Total loans	0	0
Not Rated | Agriculture
Analysis of risk category of loans by class of loans
Total loans	166	67
Not Rated | All Other Commercial
Analysis of risk category of loans by class of loans
Total loans	1,273	1,275
Not Rated | First Liens
Analysis of risk category of loans by class of loans
Total loans	189,034	196,008
Not Rated | Home Equity
Analysis of risk category of loans by class of loans
Total loans	25,247	26,116
Not Rated | Junior Liens
Analysis of risk category of loans by class of loans
Total loans	22,862	23,053
Not Rated | Multifamily
Analysis of risk category of loans by class of loans
Total loans	25	3
Not Rated | All Other Residential
Analysis of risk category of loans by class of loans
Total loans	7,892	7,228
Not Rated | Motor Vehicle
Analysis of risk category of loans by class of loans
Total loans	238,435	233,302
Not Rated | All Other Consumer
Analysis of risk category of loans by class of loans
Total loans	$ 18,833	$ 18,175