Consolidated Statements of Cash Flows - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Cash flows from operating activities:
Net income	$ 4,881	$ 9,176	$ 6,927
Adjustments to reconcile net income to net cash used in operating activities:
Provision for loan losses	12,444	6,209	4,296
Depreciation and amortization	15,502	15,930	15,833
Current income tax receivable	(3,675)	10,815	(20,498)
Deferred income tax asset	(4,241)	(15,776)	(1,618)
Discount accretion, net of premium amortization on securities	4,124	5,010	8,285
Loan accretion	(50,687)	(63,881)	(85,447)
Net gains on sales of mortgage loans	(1,963)	(1,000)	(1,358)
Originations of loans held for sale, net of repayments	(99,246)	(44,490)	(58,391)
Proceeds from sales of loans held for sale	92,845	45,584	57,947
Bank-owned life insurance income	(1,614)	(442)
Amortization of indemnification asset, net of gain on termination	15,878	27,741	18,960
Gains on the sales of other real estate owned, net	(2,776)	(13,126)	(6,953)
Impairment on other real estate owned	1,580	2,103	10,349
Impairment on fixed assets related to banking center consolidations	1,411		2,531
Gain on sales of fixed assets	(28)	(123)
Bargain purchase gain	(1,048)
Stock-based compensation	3,349	3,572	4,861
(Decrease) increase in due to FDIC, net	(37,138)	129	10,611
Decrease in other assets	4,871	3,179	945
Increase in other liabilities	7,879	6,628	7,142
Net cash used in operating activities	(37,652)	(2,762)	(25,578)
Cash flows from investing activities:
Purchase of FHLB stock		(952)
Proceeds from redemption of FHLB stock	493		1,333
Proceeds from FRB stock	5,320	5,570
Proceeds from maturities of investment securities held-to-maturity	104,683	105,594	178,420
Proceeds from maturities of investment securities available-for-sale	314,271	327,368	549,857
Proceeds from sales of investment securities available-for-sale	29,747
Purchase of investment securities held-to-maturity	(6,225)		(251,792)
Purchase of investment securities available-for-sale			(693,881)
Net increase in loans	(334,798)	(253,102)	(26,648)
Purchases of premises and equipment, net	(5,081)	(1,585)	(6,801)
Purchase of bank-owned life insurance		(43,800)
Proceeds from sales of loans	17,204	3,607	44,958
Proceeds from sales of other real estate owned	15,566	56,519	61,260
Decrease (increase) in FDIC indemnification asset	18,331	(2,376)	62,807
Net cash activity from acquisitions	22,832
Net cash provided by (used in) investing activities	182,343	196,843	(80,487)
Cash flows from financing activities:
Net decrease in deposits	(55,654)	(72,121)	(362,410)
Increase in repurchase agreements	2,971	34,005	45,862
Advances from FHLB		40,000
Issuance of stock under purchase and equity compensation plans	(1,048)	(576)	(256)
Excess tax benefit on stock-based compensation	24	7	24
Reissuance of treasury stock in excess of cost basis	96
Proceeds from exercise of stock options	160
Settlement of warrants	(368)
Payment of dividends	(6,711)	(8,507)	(10,139)
Repurchase of shares	(175,048)	(119,370)	(146,736)
Net cash used in financing activities	(235,578)	(126,562)	(473,655)
(Decrease) increase in cash and cash equivalents	(90,887)	67,519	(579,720)
Cash and cash equivalents at beginning of the year	256,979	189,460	769,180
Cash and cash equivalents at end of year	166,092	256,979	189,460
Supplemental disclosure of cash flow information during the year:
Cash paid for interest	13,751	13,863	17,694
Net tax payments	7,420	8,119	26,211
Supplemental schedule of non-cash investing activities:
Loans transferred to other real estate owned at fair value	4,576	4,491	39,973
FDIC submissions transferred to (other liabilities) other assets		(5,673)	17,605
Loans purchased but not settled	$ 9,936	$ 10,038	$ 5,063