Other Real Estate Owned (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2013	Dec. 31, 2012
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	$ 16,580	$ 45,534
Not Covered OREO	40,581	44,717
Total OREO	57,161	90,251
Residential real estate [Member]
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	3,819	8,778
Not Covered OREO	3,519	7,842
Total OREO	7,338	16,620
Commercial real estate [Member]
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	4,271	14,368
Not Covered OREO	9,122	7,779
Total OREO	13,393	22,147
Residential land development [Member]
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	1,181	5,005
Not Covered OREO	14,448	22,490
Total OREO	15,629	27,495
Commercial land development [Member]
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	7,309	17,383
Not Covered OREO	13,492	6,221
Total OREO	20,801	23,604
Other [Member]
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO		0
Not Covered OREO		385
Total OREO		$ 385