Consolidated Statements of Cash Flows (Unaudited) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Net income (loss)	$ 27,731	$ (1,864)	$ (23,400)
Adjustments to reconcile net income (loss) to net cash provided by operating activities
Depreciation	2,581	2,529	2,452
Amortization of unearned discounts / premiums on investment securities available for sale, net	4,992	6,031	4,959
Deferred income tax expense (benefit)	(19,834)	2,721	(2,663)
(Increase) decrease in income tax refunds receivable		(510)	7,436
Provision for loan losses	3,465	13,075	20,500
Trading account gains, net	(170)
Purchases of trading account assets, net	(4,948)
Gain on sale of branches		(568)
Gain on sales of mortgage loans held for sale, net	(1,803)	(2,585)	(871)
Gain on sales of Small Business Administration loans	(207)	(162)
Loss (gain) on other loans held for sale	(326)	3,660	8,119
Writedowns, gains and losses on sales of foreclosed real estate, net	2,977	8,617	6,086
Loss on prepayment of Federal Home Loan Bank advances			412
Investment securities gains, net	(310)	(10,494)	(157)
Originations of mortgage loans held for sale	(67,811)	(97,400)	(49,581)
Proceeds from sales of mortgage loans held for sale	74,006	97,519	51,597
Proceeds from sales of Small Business Administration loans	2,222	1,830
Proceeds from sales of other loans held for sale	1,102	13,922	7,952
Compensation expense on equity-based awards	1,158	1,109	823
(Increase) decrease in interest receivable and other assets, net	811	1,572	(1,053)
Decrease in interest payable and other liabilities, net	(1,208)	(1,906)	(2,488)
Net cash provided by operating activities	24,428	37,096	30,123
Investing Activities
Proceeds from sales of investment securities available for sale	48,660	181,014	4,267
Proceeds from maturities and repayments of investment securities available for sale	52,696	72,495	90,794
Purchases of investment securities available for sale	(63,141)	(260,916)	(133,354)
Purchases of Federal Home Loan Bank stock	(1,570)
Proceeds from redemption of Federal Home Loan Bank stock	431	1,691	3,283
Repayments on other loans held for sale		70	13,294
Increase in gross loans, net	(38,592)	(4,385)	(6,519)
Purchase of bank-owned life insurance	(10,000)
Proceeds on sale of foreclosed real estate	2,973	13,524	13,397
Purchases of premises and equipment, net	(1,152)	(1,521)	(1,846)
Payment for sale of branches, net		(32,272)
Net cash used for investing activities	(9,695)	(30,300)	(16,684)
Financing Activities
Increase in transaction, money market and savings deposits, net	26,327	36,980	38,809
Decrease in time deposits, net	(142,209)	(36,842)	(147,990)
Increase (decrease) in retail repurchase agreements, net	2,818	(8,501)	3,138
Proceeds from Federal Home Loan Bank advances	35,000
Repayment of Federal Home Loan Bank advances			(35,412)
Proceeds from issuance of common stock, net			7,951
Proceeds from exercise of stock options	124
Net cash used for financing activities	(77,940)	(8,363)	(133,504)
Net change in cash and due from banks	(63,207)	(1,567)	(120,065)
Cash and due from banks, beginning of period	101,385	102,952	223,017
Cash and due from banks, end of period	38,178	101,385	102,952
Cash paid (received) during the period for:
Interest expense	2,662	5,242	10,059
Income taxes paid (refunds received), net		510	(7,436)
Significant noncash activities
Increase (decrease) in net unrealized gains on investment securities available for sale, net of tax	(4,481)	(5,187)	5,414
Decrease (increase) in defined benefit pension plan net actuarial loss, net of tax	905	840	(1,205)
Loans transferred from gross loans to other loans held for sale	2,015	21,383	1,224
Loans transferred from gross loans to foreclosed real estate, at fair value	2,541	3,575	18,077
Loans transferred from other loans held for sale to gross loans, at fair value		6,143	14,752
Loans transferred from other loans held for sale to foreclosed real estate, at fair value		$ 1,814	$ 9,086