Consolidated Statements of Cash Flows - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014
Cash flows from operating activities:
Net income	$ 23,060	$ 4,881	$ 9,176
Adjustments to reconcile net income to net cash used in operating activities:
Provision for loan losses	23,651	12,444	6,209
Depreciation and amortization	14,203	15,502	15,930
Current income tax receivable	4,176	(7,328)	10,807
Deferred income tax asset	(176)	(4,241)	(15,776)
Net excess tax (benefit) deficit on stock-based compensation	(2,078)	3,677	15
Discount accretion, net of premium amortization on securities	3,067	4,124	5,010
Loan accretion	(35,073)	(50,687)	(63,881)
Gain on sale of mortgage loans, net	(2,881)	(1,963)	(1,000)
Origination of loans held for sale, net of repayments	(114,397)	(99,246)	(44,490)
Proceeds from sales of loans held for sale	101,098	92,845	45,584
Bank-owned life insurance income	(1,861)	(1,614)	(442)
Amortization of indemnification asset		15,878	27,741
Gain on the sale of other real estate owned, net	(4,383)	(2,776)	(13,126)
Impairment on other real estate owned	298	1,580	2,103
Impairment on fixed assets related to banking center consolidations		1,411
Gain on sale of fixed assets	(1,981)	(28)	(123)
Bargain purchase gain		(1,048)
Stock-based compensation	3,492	3,349	3,572
Decrease in due to FDIC, net		(37,138)	129
(Increase) decrease in other assets	(4,721)	4,871	3,179
(Decrease) increase in other liabilities	(9,430)	7,879	6,628
Net cash used in operating activities	(3,936)	(37,628)	(2,755)
Cash flows from investing activities:
Purchase of FHLB stock	(5,544)		(952)
Proceeds from redemption of FHLB stock	7,670	493
Proceeds from redemption of FRB stock	4,964	5,320	5,570
Proceeds from maturities of investment securities held-to-maturity	91,376	104,683	105,594
Proceeds from maturities of investment securities available-for-sale	275,448	314,271	327,368
Proceeds from sales of investment securities available-for-sale		29,747
Proceeds from maturities of non-marketable securities	490
Purchase of investment securities available-for-sale	(4,872)
Purchase of investment securities held-to-maturity		(6,225)
Net increase in loans	(270,585)	(334,798)	(253,102)
Sales (purchases) of premises and equipment, net	690	(5,081)	(1,585)
Purchase of bank-owned life insurance	(10,344)		(43,800)
Proceeds from sales of loans	9,231	17,204	3,607
Proceeds from sales of other real estate owned	16,105	15,566	56,519
Decrease (increase) in FDIC indemnification asset		18,331	(2,376)
Net cash activity from acquisitions		22,832
Net cash provided by investing activities	114,629	182,343	196,843
Cash flows from financing activities:
Net increase (decrease) in deposits	27,972	(55,654)	(72,121)
(Decrease) increase in repurchase agreements	(44,512)	2,971	34,005
Advances from FHLB	218,629		40,000
FHLB payoffs	(219,964)
Issuance of stock under purchase and equity compensation plans	(6,201)	(952)	(576)
Proceeds from exercise of stock options		160
Settlement of warrants		(368)
Payment of dividends	(6,400)	(6,711)	(8,507)
Repurchase of shares	(93,573)	(175,048)	(119,370)
Net cash used in financing activities	(124,049)	(235,602)	(126,569)
(Decrease) increase in cash and cash equivalents	(13,356)	(90,887)	67,519
Cash and cash equivalents at beginning of the year	166,092	256,979	189,460
Cash and cash equivalents at end of year	152,736	166,092	256,979
Supplemental disclosure of cash flow information during the period:
Cash paid for interest	14,154	13,751	13,863
Net tax refunds (payments)	2,193	(7,420)	(8,119)
Supplemental schedule of non-cash investing activities:
Loans transferred to other real estate owned at fair value	6,868	4,576	4,491
FDIC submissions transferred to other liabilities			(5,673)
Loans purchased but not settled	$ 5,285	$ 9,936	$ 10,038