Loans and the Allowance for Loan Losses - (Details 2) - USD ($) $ in Thousands	Sep. 30, 2015	Dec. 31, 2014
Impaired loans
Unpaid Contractual Principal Balance	$ 152,449	$ 127,534
Recorded Investment With Allowance	119,089	48,649
Recorded Investment With No Allowance	15,553	37,505
Total Recorded Investment	134,642	86,154
Related Allowance	9,747	10,762
Commercial, financial, agricultural
Impaired loans
Unpaid Contractual Principal Balance	8,456	4,871
Recorded Investment With Allowance	6,529	984
Recorded Investment With No Allowance	49	1,375
Total Recorded Investment	6,578	2,359
Related Allowance	599	171
Real estate – construction
Impaired loans
Unpaid Contractual Principal Balance	0	164
Recorded Investment With Allowance	0	164
Recorded Investment With No Allowance	0	0
Total Recorded Investment	0	164
Related Allowance	0	0
Real estate – 1-4 family mortgage
Impaired loans
Unpaid Contractual Principal Balance	43,363	31,906
Recorded Investment With Allowance	32,769	18,401
Recorded Investment With No Allowance	6,118	7,295
Total Recorded Investment	38,887	25,696
Related Allowance	4,773	4,824
Real estate – commercial mortgage
Impaired loans
Unpaid Contractual Principal Balance	99,819	90,196
Recorded Investment With Allowance	79,292	29,079
Recorded Investment With No Allowance	9,379	28,784
Total Recorded Investment	88,671	57,863
Related Allowance	4,374	5,767
Installment loans to individuals
Impaired loans
Unpaid Contractual Principal Balance	811	397
Recorded Investment With Allowance	499	21
Recorded Investment With No Allowance	7	51
Total Recorded Investment	506	72
Related Allowance	$ 1	$ 0