Portfolio Loans Not Covered by Loss Share ("Non-covered") - Summary of Non-covered Loans by Category (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total	$ 2,137,313	$ 2,106,039
Non-Covered Loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Portfolio Loans	2,136,292	2,106,028
Unearned loan costs, net	1,021	11
Total	2,137,313	2,106,039
Non-Covered Loans | Real Estate Loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Portfolio Loans	1,054,878	1,126,178
Non-Covered Loans | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Portfolio Loans	1,041,576	962,884
Non-Covered Loans | Consumer & other
Accounts, Notes, Loans and Financing Receivable [Line Items]
Portfolio Loans	39,838	16,966
Total	40,859	16,977
Non-Covered Loans | Construction and Land Development
Accounts, Notes, Loans and Financing Receivable [Line Items]
Portfolio Loans	117,032	160,911
Non-Covered Loans | Commercial - Investor Owned
Accounts, Notes, Loans and Financing Receivable [Line Items]
Portfolio Loans	437,688	486,467
Non-Covered Loans | Commercial - Owner Occupied
Accounts, Notes, Loans and Financing Receivable [Line Items]
Portfolio Loans	341,631	333,242
Non-Covered Loans | Residential
Accounts, Notes, Loans and Financing Receivable [Line Items]
Portfolio Loans	$ 158,527	$ 145,558