Other Real Estate Owned - (Details) - USD ($) $ in Thousands	Jun. 30, 2016	Dec. 31, 2015
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	$ 2,618	$ 2,818
Not Covered OREO	26,721	32,584
Total other real estate owned, net	29,339	35,402
Residential real estate
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	1,215	529
Not Covered OREO	2,324	4,265
Total other real estate owned, net	3,539	4,794
Commercial real estate
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	86	346
Not Covered OREO	9,653	11,041
Total other real estate owned, net	9,739	11,387
Residential land development
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	1	1
Not Covered OREO	4,228	4,595
Total other real estate owned, net	4,229	4,596
Commercial land development
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	1,316	1,942
Not Covered OREO	10,516	12,683
Total other real estate owned, net	$ 11,832	$ 14,625