Loans and the Allowance for Loan Losses - (Details 2) - USD ($) $ in Thousands	Jun. 30, 2015	Dec. 31, 2014
Impaired loans
Unpaid Contractual Principal Balance	$ 97,594	$ 127,534
Recorded Investment With Allowance	52,799	48,649
Recorded Investment With No Allowance	19,121	37,505
Total Recorded Investment	71,920	86,154
Related Allowance	8,905	10,762
Commercial, financial, agricultural
Impaired loans
Unpaid Contractual Principal Balance	3,662	4,871
Recorded Investment With Allowance	1,746	984
Recorded Investment With No Allowance	72	1,375
Total Recorded Investment	1,818	2,359
Related Allowance	342	171
Real estate – construction
Impaired loans
Unpaid Contractual Principal Balance	0	164
Recorded Investment With Allowance	0	164
Recorded Investment With No Allowance	0	0
Total Recorded Investment	0	164
Related Allowance	0	0
Real estate – 1-4 family mortgage
Impaired loans
Unpaid Contractual Principal Balance	31,118	31,906
Recorded Investment With Allowance	18,231	18,401
Recorded Investment With No Allowance	7,607	7,295
Total Recorded Investment	25,838	25,696
Related Allowance	4,454	4,824
Real estate – commercial mortgage
Impaired loans
Unpaid Contractual Principal Balance	62,015	90,196
Recorded Investment With Allowance	32,352	29,079
Recorded Investment With No Allowance	11,431	28,784
Total Recorded Investment	43,783	57,863
Related Allowance	3,898	5,767
Installment loans to individuals
Impaired loans
Unpaid Contractual Principal Balance	799	397
Recorded Investment With Allowance	470	21
Recorded Investment With No Allowance	11	51
Total Recorded Investment	481	72
Related Allowance	$ 211	$ 0