Loans and Asset Quality Information (Details 11) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Dec. 31, 2013	Jun. 30, 2013
Recorded investment in loans by credit quality indicators:
Non-covered loans	$ 2,256,879	$ 2,251,957
Unamortized net deferred loan costs	651	928	1,168
Covered loans	176,855	210,309	240,279
Total loans	2,434,385	2,463,194	2,430,862
Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	2,257,530	2,252,885
Commercial Unsecured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	36,077	37,015
Commercial Secured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	124,101	122,280
Secured by Inventory and Accounts Receivable [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	18,492	21,176
Real estate construction, land development other land loans [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	247,369	244,670
Real estate residential, farmland and mutli-family [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	867,175	869,387
Real estate home equity lines of credit [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	200,510	198,127
Real estate commercial [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	717,905	709,606
Consumer [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	45,250	49,696
Pass (Grades 1, 2 and 3) [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	625,925	563,666
Covered loans	17,850	25,078
Total loans	643,775	588,744
Pass (Grades 1, 2 and 3) [Member] | Commercial Unsecured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	11,722	8,495
Pass (Grades 1, 2 and 3) [Member] | Commercial Secured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	34,642	31,494
Pass (Grades 1, 2 and 3) [Member] | Secured by Inventory and Accounts Receivable [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	5,863	4,098
Pass (Grades 1, 2 and 3) [Member] | Real estate construction, land development other land loans [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	65,376	31,221
Pass (Grades 1, 2 and 3) [Member] | Real estate residential, farmland and mutli-family [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	222,681	227,053
Pass (Grades 1, 2 and 3) [Member] | Real estate home equity lines of credit [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	122,853	120,205
Pass (Grades 1, 2 and 3) [Member] | Real estate commercial [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	138,088	115,397
Pass (Grades 1, 2 and 3) [Member] | Consumer [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	24,700	25,703
Weak Pass (Grade 4) [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	1,394,253	1,454,925
Covered loans	96,435	92,147
Total loans	1,490,688	1,547,072
Weak Pass (Grade 4) [Member] | Commercial Unsecured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	20,737	24,415
Weak Pass (Grade 4) [Member] | Commercial Secured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	76,763	77,441
Weak Pass (Grade 4) [Member] | Secured by Inventory and Accounts Receivable [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	9,912	12,800
Weak Pass (Grade 4) [Member] | Real estate construction, land development other land loans [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	149,982	181,050
Weak Pass (Grade 4) [Member] | Real estate residential, farmland and mutli-family [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	536,597	540,349
Weak Pass (Grade 4) [Member] | Real estate home equity lines of credit [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	64,446	63,400
Weak Pass (Grade 4) [Member] | Real estate commercial [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	517,412	533,680
Weak Pass (Grade 4) [Member] | Consumer [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	18,404	21,790
Watch or Standard Loans (Grade 9) [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	17,346	19,101
Covered loans	82
Total loans	17,428	19,101
Watch or Standard Loans (Grade 9) [Member] | Commercial Unsecured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	7	7
Watch or Standard Loans (Grade 9) [Member] | Commercial Secured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	93	100
Watch or Standard Loans (Grade 9) [Member] | Secured by Inventory and Accounts Receivable [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans
Watch or Standard Loans (Grade 9) [Member] | Real estate construction, land development other land loans [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	2,118	2,365
Watch or Standard Loans (Grade 9) [Member] | Real estate residential, farmland and mutli-family [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	5,038	5,062
Watch or Standard Loans (Grade 9) [Member] | Real estate home equity lines of credit [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	1,293	1,499
Watch or Standard Loans (Grade 9) [Member] | Real estate commercial [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	8,743	10,014
Watch or Standard Loans (Grade 9) [Member] | Consumer [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	54	54
Special Mention Loans (Grade 5) [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	96,425	93,442
Covered loans	12,888	8,857
Total loans	109,313	102,299
Special Mention Loans (Grade 5) [Member] | Commercial Unsecured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	1,435	1,509
Special Mention Loans (Grade 5) [Member] | Commercial Secured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	4,403	5,597
Special Mention Loans (Grade 5) [Member] | Secured by Inventory and Accounts Receivable [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	1,346	2,022
Special Mention Loans (Grade 5) [Member] | Real estate construction, land development other land loans [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	11,174	11,646
Special Mention Loans (Grade 5) [Member] | Real estate residential, farmland and mutli-family [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	45,084	41,583
Special Mention Loans (Grade 5) [Member] | Real estate home equity lines of credit [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	4,030	5,699
Special Mention Loans (Grade 5) [Member] | Real estate commercial [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	28,269	24,557
Special Mention Loans (Grade 5) [Member] | Consumer [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	684	829
Classified Loans (Grades 6,7 and 8) [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	75,397	78,885
Covered loans	28,662	47,010
Total loans	104,059	125,895
Classified Loans (Grades 6,7 and 8) [Member] | Commercial Unsecured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	2,066	2,367
Classified Loans (Grades 6,7 and 8) [Member] | Commercial Secured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	4,572	4,986
Classified Loans (Grades 6,7 and 8) [Member] | Secured by Inventory and Accounts Receivable [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	1,033	1,711
Classified Loans (Grades 6,7 and 8) [Member] | Real estate construction, land development other land loans [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	9,718	10,333
Classified Loans (Grades 6,7 and 8) [Member] | Real estate residential, farmland and mutli-family [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	36,607	37,526
Classified Loans (Grades 6,7 and 8) [Member] | Real estate home equity lines of credit [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	5,452	5,124
Classified Loans (Grades 6,7 and 8) [Member] | Real estate commercial [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	15,096	15,843
Classified Loans (Grades 6,7 and 8) [Member] | Consumer [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	853	995
Nonaccrual Loans [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	47,533	41,938
Covered loans	20,938	37,217
Total loans	68,471	79,155
Nonaccrual Loans [Member] | Commercial Unsecured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	110	222
Nonaccrual Loans [Member] | Commercial Secured [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	3,628	2,662
Nonaccrual Loans [Member] | Secured by Inventory and Accounts Receivable [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	338	545
Nonaccrual Loans [Member] | Real estate construction, land development other land loans [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	9,001	8,055
Nonaccrual Loans [Member] | Real estate residential, farmland and mutli-family [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	21,168	17,814
Nonaccrual Loans [Member] | Real estate home equity lines of credit [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	2,436	2,200
Nonaccrual Loans [Member] | Real estate commercial [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	10,297	10,115
Nonaccrual Loans [Member] | Consumer [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	$ 555	$ 325