Other Real Estate Owned (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	$ 12,942	$ 45,534
Not Covered OREO	39,945	44,717
Total OREO	52,887	90,251
Residential real estate
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	2,133	8,778
Not Covered OREO	6,767	7,842
Total OREO	8,900	16,620
Real estate – commercial mortgage
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	3,598	14,368
Not Covered OREO	8,984	7,779
Total OREO	12,582	22,147
Residential land development
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	1,161	5,005
Not Covered OREO	12,334	22,490
Total OREO	13,495	27,495
Commercial land development
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	6,050	17,383
Not Covered OREO	11,860	6,221
Total OREO	17,910	23,604
Other
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	0	0
Not Covered OREO	0	385
Total OREO	$ 0	$ 385