Other Real Estate Owned - (Details) - USD ($) $ in Thousands	Sep. 30, 2016	Dec. 31, 2015
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	$ 926	$ 2,818
Not Covered OREO	25,402	32,584
Total other real estate owned, net	26,328	35,402
Residential real estate
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	925	529
Not Covered OREO	2,103	4,265
Total other real estate owned, net	3,028	4,794
Commercial real estate
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	0	346
Not Covered OREO	8,412	11,041
Total other real estate owned, net	8,412	11,387
Residential land development
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	1	1
Not Covered OREO	4,139	4,595
Total other real estate owned, net	4,140	4,596
Commercial land development
Other real estate owned ("OREO") covered and not covered under a loss-share agreement, net of valuation allowances and direct write-downs
Covered OREO	0	1,942
Not Covered OREO	10,748	12,683
Total other real estate owned, net	$ 10,748	$ 14,625