Loans and the Allowance for Loan Losses (Details 2) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013
Impaired loans
Unpaid Contractual Principal Balance	$ 145,767	$ 161,473
Recorded Investment With Allowance	46,896	56,924
Recorded Investment With No Allowance	45,020	50,827
Total Recorded Investment	91,916	107,751
Related Allowance	13,274	14,650
Commercial, financial, agricultural
Impaired loans
Unpaid Contractual Principal Balance	5,513	6,575
Recorded Investment With Allowance	349	743
Recorded Investment With No Allowance	2,383	2,043
Total Recorded Investment	2,732	2,786
Related Allowance	229	260
Real estate – construction
Impaired loans
Unpaid Contractual Principal Balance	2,723	2,447
Recorded Investment With Allowance	0	0
Recorded Investment With No Allowance	1,768	1,648
Total Recorded Investment	1,768	1,648
Related Allowance	48	0
Real estate – 1-4 family mortgage
Impaired loans
Unpaid Contractual Principal Balance	31,657	42,868
Recorded Investment With Allowance	15,576	25,374
Recorded Investment With No Allowance	8,440	8,542
Total Recorded Investment	24,016	33,916
Related Allowance	2,316	7,353
Real estate – commercial mortgage
Impaired loans
Unpaid Contractual Principal Balance	105,441	108,963
Recorded Investment With Allowance	30,921	30,624
Recorded Investment With No Allowance	32,373	38,517
Total Recorded Investment	63,294	69,141
Related Allowance	10,681	7,036
Installment loans to individuals
Impaired loans
Unpaid Contractual Principal Balance	433	620
Recorded Investment With Allowance	50	183
Recorded Investment With No Allowance	56	77
Total Recorded Investment	106	260
Related Allowance	$ 0	$ 1