Loans and the Allowance for Loan Losses (Details 2) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2013	Dec. 31, 2012
Impaired loans
Unpaid Contractual Principal Balance	$ 156,202	$ 205,778
Recorded Investment With Allowance	56,433	64,868
Recorded Investment With No Allowance	47,886	52,812
Total Recorded Investment	104,319	117,680
Related Allowance	14,908	17,597
Commercial, financial, agricultural [Member]
Impaired loans
Unpaid Contractual Principal Balance	6,536	5,142
Recorded Investment With Allowance	603	1,620
Recorded Investment With No Allowance	2,193	1,620
Total Recorded Investment	2,796	3,240
Related Allowance	260	708
Lease financing [Member]
Impaired loans
Unpaid Contractual Principal Balance	0	0
Recorded Investment With Allowance	0	0
Recorded Investment With No Allowance	0	0
Total Recorded Investment	0	0
Related Allowance	0	0
Real estate - construction [Member]
Impaired loans
Unpaid Contractual Principal Balance	2,447	2,447
Recorded Investment With Allowance	0	0
Recorded Investment With No Allowance	1,648	1,648
Total Recorded Investment	1,648	1,648
Related Allowance	0	0
Real estate - 1-4 family mortgage [Member]
Impaired loans
Unpaid Contractual Principal Balance	39,279	80,022
Recorded Investment With Allowance	25,285	28,848
Recorded Investment With No Allowance	4,776	10,094
Total Recorded Investment	30,061	38,942
Related Allowance	7,569	9,201
Real estate - commercial mortgage [Member]
Impaired loans
Unpaid Contractual Principal Balance	107,940	118,167
Recorded Investment With Allowance	30,545	34,400
Recorded Investment With No Allowance	39,269	39,450
Total Recorded Investment	69,814	73,850
Related Allowance	7,079	7,688
Installment loans to individuals [Member]
Impaired loans
Unpaid Contractual Principal Balance	0	0
Recorded Investment With Allowance	0	0
Recorded Investment With No Allowance	0	0
Total Recorded Investment	0	0
Related Allowance	$ 0	$ 0