Other Real Estate Owned (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2014	Dec. 31, 2013
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	$ 10,218	$ 12,942
Not Covered OREO	37,523	39,945
Total other real estate owned, net	47,741	52,887
Residential real estate
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	1,671	2,133
Not Covered OREO	6,466	6,767
Total other real estate owned, net	8,137	8,900
Commercial real estate
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	3,083	3,598
Not Covered OREO	8,513	8,984
Total other real estate owned, net	11,596	12,582
Residential land development
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	916	1,161
Not Covered OREO	10,419	12,334
Total other real estate owned, net	11,335	13,495
Commercial land development
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	4,548	6,050
Not Covered OREO	12,125	11,860
Total other real estate owned, net	16,673	17,910
Other
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO		0
Not Covered OREO		0
Total other real estate owned, net		$ 0