Consolidated Statements of Operations (USD $) In Thousands, except Per Share data, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2013	Jun. 30, 2012	Jun. 30, 2013	Jun. 30, 2012
Interest income:
Loans	$ 9,469	$ 10,795	$ 20,262	$ 22,077
Securities and other earning assets	453	375	793	711
Total interest income	9,922	11,170	21,055	22,788
Interest expense:
Deposits	2,772	2,871	5,725	5,959
Short-term borrowings	3	31	18	64
Long-term borrowings	755	921	1,775	1,853
Total interest expense	3,530	3,823	7,518	7,876
Net interest income	6,392	7,347	13,537	14,912
(reversal of) provision for loan losses		(428)	1,300	572
Net interest income after (reversal of) provision for loan losses	6,392	7,775	12,237	14,340
Noninterest income:
Total other-than-temporary impairment ("OTTI") charges		43		81
Less: Portion included in other comprehensive income (pre-tax)		(43)		(541)
Net OTTI charges on AFS securities				(460)
Mortgage-banking revenue	5,366	11,117	15,155	20,066
ATM fees	623	701	1,139	1,418
Service fees on deposits	701	623	1,327	1,304
Gain on sale of AFS securities	24		55
Loss on disposition and sale of premises and equipment and other assets	(3)	(230)	(3)	(322)
Commissions on sales of nondeposit investment products	114	87	159	149
Gain on sale of minority interest in Mariner Finance	2,885		2,885
Income from BOLI	252	287	511	580
Other	343	249	684	479
Total noninterest income	10,305	12,834	21,912	23,214
Noninterest expense:
Salaries and employee benefits	6,425	5,552	13,305	11,331
Occupancy	1,968	2,286	4,258	4,508
Furniture, fixtures, and equipment	396	324	785	686
Professional services	1,910	739	2,717	1,112
Advertising	335	231	777	420
Data processing	418	402	621	834
ATM servicing expenses	92	226	197	453
Write-downs, losses, and costs of real estate acquired through foreclosure	1,012	940	3,697	2,214
Federal Deposit Insurance Corporation ("FDIC") insurance premiums	1,128	1,074	2,338	2,122
Service and maintenance	791	564	1,507	1,155
Corporate Insurance	786	402	1,580	876
Consulting fees	417	316	829	924
Postage	943	422	1,994	681
Other	1,559	1,459	3,297	2,951
Total noninterest expense	18,180	14,937	37,902	30,267
Net (loss) income before income taxes	(1,483)	5,672	(3,753)	7,287
Income tax expense (benefit)	1		1	(205)
Net (loss) income	$ (1,484)	$ 5,672	$ (3,754)	$ 7,492
Net (loss) income per common share - basic and diluted (in dollars per share)	$ (0.08)	$ 0.30	$ (0.20)	$ 0.40