Income Taxes (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2012	Dec. 31, 2011
Components of income tax expense (benefit)
Deferred federal	$ (302)	$ (719)
Deferred state	(436)	(5,214)
Deferred tax valuation allowance	738	5,933
Income tax expense (benefit)	0	0
Deferred tax assets
Allowance for loan losses	18,236	24,361
Deferred compensation	679	628
Amortization of core deposit intangible assets	965	583
Goodwill amortization/impairment	16,796	18,322
Stock option expense	785	1,111
OREO write downs	16,632	10,094
Federal net operating loss (NOL) carryforward	20,736	19,810
State net operating loss (NOL) carryforward	10,186	9,740
Deferred tax credit	1,444	1,444
Other assets	585	408
Total deferred tax assets	87,044	86,501
Deferred tax liabilities
Accumulated depreciation on premises and equipment	(1,063)	(1,265)
Accretion on securities	(122)	(37)
Mortgage servicing rights	(1,819)	(1,538)
State tax benefits	(7,315)	(7,201)
Other liabilities	(217)	(690)
Total deferred tax liabilities	(10,536)	(10,731)
Net deferred tax asset before valuation allowance	76,508	75,770
Tax benefit on net unrealized losses on securities	928	2,592
Valuation allowance	(76,508)	(75,770)
Net deferred tax asset	$ 928	$ 2,592