Consolidated Statements of Income (Loss) (USD $) In Thousands, except Share data, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Interest income
Interest earned on cash and cash equivalents	$ 100	$ 209	$ 347
Dividends received on Federal Home Loan Bank stock	39	47	48
Interest earned on trading account assets	38
Interest earned on investment securities available for sale	4,017	5,059	6,921
Interest and fees earned on loans	38,344	40,075	44,502
Total interest income	42,538	45,390	51,818
Interest expense
Interest expense on deposits	2,257	5,136	9,334
Interest expense on retail repurchase agreements	2	2	20
Interest expense on Federal Home Loan Bank advances			72
Interest expense on other borrowings	1
Total interest expense	2,260	5,138	9,426
Net interest income	40,278	40,252	42,392
Provision for loan losses	3,465	13,075	20,500
Net interest income after provision for loan losses	36,813	27,177	21,892
Noninterest income
Service charges on deposit accounts, net	6,902	6,691	7,547
Fees for trust, investment management and brokerage services	2,039	3,092	3,083
Mortgage-banking	2,008	3,139	1,757
Debit card and automatic teller machine income, net	2,400	2,171	1,915
Bankcard services	261	247	238
Investment securities gains, net	310	10,494	157
Trading account income	170
Gain on sale of branches		568
Other	746	628	729
Total noninterest income	14,836	27,030	15,426
Noninterest expense
Salaries and other personnel	20,107	21,088	23,807
Occupancy	4,242	4,455	4,503
Furniture and equipment	3,731	3,378	3,807
Professional services	2,083	1,715	1,960
Federal Deposit Insurance Corporation deposit insurance assessment	1,439	1,861	3,012
Marketing	1,051	1,384	1,803
Foreclosed real estate writedowns and expenses	3,373	9,285	7,470
Loss (gain) on other loans held for sale	(326)	3,660	8,119
Loan workout	1,066	1,273	1,654
Other	5,567	5,251	7,247
Total noninterest expense	42,333	53,350	63,382
Income (loss) before provision (benefit) for income taxes	9,316	857	(26,064)
Provision (benefit) for income taxes	(18,415)	2,721	(2,664)
Net income (loss)	$ 27,731	$ (1,864)	$ (23,400)
Common and per share data
Net income (loss) - basic (in Dollars per share)	$ 2.17	$ (0.15)	$ (1.86)
Net income (loss) - diluted (in Dollars per share)	$ 2.17	$ (0.15)	$ (1.86)
Cash dividends (in Dollars per share)	$ 0	$ 0	$ 0
Book value (in Dollars per share)	$ 9.68	$ 7.71	$ 8.13
Average common shares issued and outstanding (in Shares)	12,658,752	12,639,379	12,555,247
Average diluted common shares issued and outstanding (in Shares)	12,658,752	12,639,379	12,555,247