Income Taxes (Deferred Tax Assets and Liabilities) (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Deferred Tax Assets, Gross [Abstract]
Allowance for losses on loans	$ 3,152	$ 4,960
OTTI	735	594
OREO chargeoffs	13	40
NOL carryforward	16,061	16,094
Deferred gain on sale of premises	76	1,161
Deferred rent	85	329
Office properties and equipment	1,984	0
Deferred compensation	449	792
Core deposit intangible	64	37
Goodwill	212	324
Other	333	292
Total	23,164	24,623
Deferred Tax Liabilities, Gross [Abstract]
Warrant liability	(71)	0
Investments and Derivatives	(2,180)	(1,766)
FHLB stock	(74)	(74)
Deferred Tax Liabilities, Property, Plant and Equipment	0	(844)
Total	(2,325)	(2,684)
Deferred tax asset valuation allowance	(8,492)	(8,766)	(8,800)
Total deferred income taxes, Assets	14,672	15,857
Total deferred income taxes, Liabilities	$ (2,325)	$ (2,684)