CONSOLIDATED STATEMENTS OF INCOME (USD $)	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
INTEREST INCOME:
Loans, including fees	$ 124,843,000	$ 170,542,000	$ 177,715,000
Taxable investment securities	8,067,000	10,729,000	15,309,000
Federal Home Loan Bank stock and other	1,658,000	2,188,000	2,091,000
Total interest income	134,568,000	183,459,000	195,115,000
INTEREST EXPENSE:
Deposits	4,093,000	5,074,000	8,914,000
Securities sold under agreements to repurchase and other short-term borrowings	70,000	375,000	646,000
Federal Home Loan Bank advances	14,715,000	14,833,000	18,180,000
Subordinated note	2,515,000	2,522,000	2,515,000
Total interest expense	21,393,000	22,804,000	30,255,000
NET INTEREST INCOME	113,175,000	160,655,000	164,860,000
Provision for loan losses	2,983,000	15,043,000	17,966,000
NET INTEREST INCOME AFTER PROVISION FOR LOAN LOSSES	110,192,000	145,612,000	146,894,000
NON INTEREST INCOME:
Service charges on deposit accounts	13,953,000	13,496,000	14,105,000
Net refund transfer fees	13,884,000	78,304,000	88,195,000
Mortgage banking income	7,258,000	8,447,000	3,899,000
Debit card interchange fee income	6,512,000	5,817,000	5,791,000
Bargain purchase gain	1,324,000	55,438,000
Gain on sale of banking center			2,856,000
Gain on sale of securities available for sale		56,000	2,285,000
Net gain on sale of other real estate owned	2,170,000	416,000	444,000
Increase in cash surrender value of bank owned life insurance	86,000
Total impairment losses on investment securities		(56,000)	(279,000)
Net impairment loss recognized in earnings			(279,000)
Other	2,782,000	3,104,000	2,328,000
Total non interest income	47,969,000	165,078,000	119,624,000
NON INTEREST EXPENSES:
Salaries and employee benefits	57,778,000	60,633,000	54,966,000
Occupancy and equipment, net	21,918,000	22,474,000	21,713,000
Communication and transportation	4,128,000	5,806,000	5,695,000
Marketing and development	3,353,000	3,429,000	3,237,000
FDIC insurance expense	1,682,000	1,403,000	4,425,000
Bank franchise tax expense	4,115,000	3,916,000	3,645,000
Data processing	3,333,000	4,309,000	3,207,000
Debit card interchange expense	2,850,000	2,462,000	2,239,000
Supplies	1,157,000	2,114,000	2,353,000
Other real estate owned expense	3,446,000	3,537,000	2,356,000
Charitable contributions	1,004,000	3,341,000	5,933,000
Legal expense	4,627,000	1,866,000	3,969,000
FDIC civil money penalty			900,000
FHLB advance prepayment penalty		2,436,000
Other	8,272,000	9,019,000	7,683,000
Total non interest expenses	117,663,000	126,745,000	122,321,000
INCOME BEFORE INCOME TAX EXPENSE	40,498,000	183,945,000	144,197,000
INCOME TAX EXPENSE	15,075,000	64,606,000	50,048,000
NET INCOME	25,423,000	119,339,000	94,149,000
Tennessee Commerce Bank
NON INTEREST INCOME:
Bargain purchase gain		27,614,000
First Commercial Bank
NON INTEREST INCOME:
Bargain purchase gain	$ 1,324,000	$ 27,824,000
Class A Common Stock
BASIC EARNINGS PER SHARE:
Basic earnings per share (in dollars per share)	$ 1.23	$ 5.71	$ 4.50
DILUTED EARNINGS PER SHARE:
Diluted earnings per share (in dollars per share)	$ 1.22	$ 5.69	$ 4.49
DIVIDENDS DECLARED PER COMMON SHARE:
Dividend declared per common share (in dollars per share)	$ 0.693	$ 1.749	$ 0.605
Class B Common Stock
BASIC EARNINGS PER SHARE:
Basic earnings per share (in dollars per share)	$ 1.17	$ 5.55	$ 4.45
DILUTED EARNINGS PER SHARE:
Diluted earnings per share (in dollars per share)	$ 1.16	$ 5.53	$ 4.44
DIVIDENDS DECLARED PER COMMON SHARE:
Dividend declared per common share (in dollars per share)	$ 0.630	$ 1.590	$ 0.550