Loans and the Allowance for Loan Losses (Details 2) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Dec. 31, 2013
Impaired loans
Unpaid Contractual Principal Balance	$ 160,149	$ 161,473
Recorded Investment With Allowance	58,502	56,924
Recorded Investment With No Allowance	49,448	50,827
Total Recorded Investment	107,950	107,751
Related Allowance	14,983	14,650
Commercial, financial, agricultural
Impaired loans
Unpaid Contractual Principal Balance	6,933	6,575
Recorded Investment With Allowance	701	743
Recorded Investment With No Allowance	2,648	2,043
Total Recorded Investment	3,349	2,786
Related Allowance	248	260
Real estate – construction
Impaired loans
Unpaid Contractual Principal Balance	2,832	2,447
Recorded Investment With Allowance	0	0
Recorded Investment With No Allowance	1,877	1,648
Total Recorded Investment	1,877	1,648
Related Allowance	0	0
Real estate – 1-4 family mortgage
Impaired loans
Unpaid Contractual Principal Balance	28,062	42,868
Recorded Investment With Allowance	15,270	25,374
Recorded Investment With No Allowance	3,989	8,542
Total Recorded Investment	19,259	33,916
Related Allowance	3,009	7,353
Real estate – commercial mortgage
Impaired loans
Unpaid Contractual Principal Balance	122,322	108,963
Recorded Investment With Allowance	42,531	30,624
Recorded Investment With No Allowance	40,934	38,517
Total Recorded Investment	83,465	69,141
Related Allowance	11,726	7,036
Installment loans to individuals
Impaired loans
Unpaid Contractual Principal Balance	0	620
Recorded Investment With Allowance	0	183
Recorded Investment With No Allowance	0	77
Total Recorded Investment	0	260
Related Allowance	$ 0	$ 1