Loans and the Allowance for Loan Losses (Details 2) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2013	Dec. 31, 2012
Impaired loans
Unpaid Contractual Principal Balance	$ 153,108	$ 205,778
Recorded Investment With Allowance	53,386	64,868
Recorded Investment With No Allowance	46,206	52,812
Total Recorded Investment	99,592	117,680
Related Allowance	15,944	17,597
Commercial, financial, agricultural [Member]
Impaired loans
Unpaid Contractual Principal Balance	6,895	5,142
Recorded Investment With Allowance	1,515	1,620
Recorded Investment With No Allowance	2,120	1,620
Total Recorded Investment	3,635	3,240
Related Allowance	834	708
Lease financing [Member]
Impaired loans
Unpaid Contractual Principal Balance	0	0
Recorded Investment With Allowance	0	0
Recorded Investment With No Allowance	0	0
Total Recorded Investment	0	0
Related Allowance	0	0
Real estate - construction [Member]
Impaired loans
Unpaid Contractual Principal Balance	2,447	2,447
Recorded Investment With Allowance	0	0
Recorded Investment With No Allowance	1,648	1,648
Total Recorded Investment	1,648	1,648
Related Allowance	0	0
Real estate - 1-4 family mortgage [Member]
Impaired loans
Unpaid Contractual Principal Balance	42,185	80,022
Recorded Investment With Allowance	26,596	28,848
Recorded Investment With No Allowance	6,172	10,094
Total Recorded Investment	32,768	38,942
Related Allowance	7,843	9,201
Real estate - commercial mortgage [Member]
Impaired loans
Unpaid Contractual Principal Balance	101,581	118,167
Recorded Investment With Allowance	25,275	34,400
Recorded Investment With No Allowance	36,266	39,450
Total Recorded Investment	61,541	73,850
Related Allowance	7,267	7,688
Installment loans to individuals [Member]
Impaired loans
Unpaid Contractual Principal Balance	0	0
Recorded Investment With Allowance	0	0
Recorded Investment With No Allowance	0	0
Total Recorded Investment	0	0
Related Allowance	$ 0	$ 0