Other Real Estate Owned (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2013	Dec. 31, 2012
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	$ 27,835	$ 45,534
Not Covered OREO	33,247	44,717
Total OREO	61,082	90,251
Residential real estate [Member]
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	5,091	8,778
Not Covered OREO	3,368	7,842
Total OREO	8,459	16,620
Commercial real estate [Member]
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	7,955	14,368
Not Covered OREO	9,139	7,779
Total OREO	17,094	22,147
Residential land development [Member]
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	2,318	5,005
Not Covered OREO	15,137	22,490
Total OREO	17,455	27,495
Commercial land development [Member]
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	12,471	17,383
Not Covered OREO	5,603	6,221
Total OREO	18,074	23,604
Other [Member]
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	0	0
Not Covered OREO	0	385
Total OREO	$ 0	$ 385