Quarterly Financial Data (Unaudited) (Details) (USD $) In Thousands, except Share data, unless otherwise specified	3 Months Ended								12 Months Ended
	Dec. 31, 2012	Sep. 30, 2012	Jun. 30, 2012	Mar. 31, 2012	Dec. 31, 2011	Sep. 30, 2011	Jun. 30, 2011	Mar. 31, 2011	Dec. 31, 2012		Dec. 31, 2011		Dec. 31, 2010
Quarterly Financial Data [Abstract]
Interest income	$ 8,594	$ 8,927	$ 9,126	$ 9,120	$ 9,770	$ 10,609	$ 10,790	$ 10,488	$ 35,767		$ 41,657		$ 46,049
Interest expense	(1,012)	(1,258)	(1,315)	(1,498)	(1,429)	(1,802)	(1,805)	(1,776)	(5,083)		(6,812)		(10,785)
Provision for losses on loans	(618)	(1,155)	(1,575)	(959)	(704)	(2,239)	(2,712)	(1,634)	(4,306)		(7,289)		(24,012)
Net interest income after provision for losses on loans	6,964	6,514	6,236	6,663	7,637	6,568	6,273	7,078	26,378		27,556		11,252
Other income	3,070	2,552	2,768	2,436	2,745	2,484	2,733	2,663	10,826		10,625		11,024
Operating expenses	(8,671)	(8,242)	(8,222)	(8,298)	(9,167)	(9,812)	(9,611)	(9,740)	(33,433)		(38,330)		(54,894)
Loss before income taxes	1,363	824	782	801	1,215	(760)	(605)	1	3,771		(149)		(32,618)
Income tax provision (benefit)	8	0	0	0	152	0	0	0	8		152		882
Net income	1,371	824	782	801	1,367	(760)	(605)	1	3,779		3		(31,736)
Preferred stock dividend	462	482	481	466	460	457	448	443	1,891		1,808		1,716
Net income available to common stockholders	$ 909	$ 342	$ 301	$ 335	$ 907	$ (1,217)	$ (1,053)	$ (442)	$ 1,888		$ (1,805)		$ (33,452)
Earnings (loss) per share — basic (in dollars per share)	$ 0.14	$ 0.05	$ 0.05	$ 0.08	$ 1.08	$ (1.44)	$ (1.25)	$ (0.53)	$ 0.33	[1]	$ (2.15)	[1]	$ (39.89)	[1]
Earnings (loss) per share — diluted (in dollars per share)	$ 0.14	$ 0.05	$ 0.05	$ 0.08	$ 1.08	$ (1.44)	$ (1.25)	$ (0.53)	$ 0.32	[1]	$ (2.15)	[1]	$ (39.89)	[1]
Weighted average shares outstanding — basic	6,442,729	6,441,986	5,901,321	4,427,831	840,984	840,984	840,979	839,650	5,806,958	[1]	840,654	[1]	838,562	[1]
Weighted average shares outstanding — diluted	6,470,944	6,458,228	5,919,188	4,442,673	842,733	840,984	840,979	839,650	5,825,283	[1],[2]	840,654	[1],[2]	838,562	[1],[2]

[1] All share numbers have been adjusted to reflect the impact of a 10-for-1 reverse stock split, effective, October 5, 2012. See footnote 14, "Stockholders' Equity" for additional information.

[2] Includes the weighted average number of non-voting common shares that would be outstanding if the warrants issued in the January 2012 private offering are exercised directly for 170,000 non-voting common shares, utilizing the Treasury stock method.