Loans and Allowance for Loan Losses - Loans Receivable (Details) (USD $)	3 Months Ended	12 Months Ended
	Dec. 31, 2012	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Loans Receivable
Loans	$ 1,308,372,000	$ 1,308,372,000	$ 1,450,039,000
Less: Net deferred loan origination fees	1,132,000	1,132,000	885,000
Allowance for loan losses	(25,149,000)	(25,149,000)	(32,848,000)
Net loans	1,284,355,000	1,284,355,000	1,418,076,000	1,562,787,000
Loans sold during period	43,000,000	319,200,000
Provision	35,000,000	40,374,000	20,843,000
Loans transferred to permanent commercial real estate loans	25,300,000
Nonperforming Loans
Loans Receivable
Loans sold during period	36,000,000
Real Estate Loans | Construction Loans
Loans Receivable
Loans	131,981,000	131,981,000	202,803,000
Provision		12,742,000	5,581,000
Real Estate Loans | Commercial Real Estate
Loans Receivable
Loans	554,500,000	554,500,000	591,800,000
Real Estate Loans | Owner Occupied
Loans Receivable
Loans	342,962,000	342,962,000	348,931,000
Provision		5,751,000	3,309,000
Real Estate Loans | Non-owner Occupied
Loans Receivable
Loans	211,489,000	211,489,000	242,827,000
Provision		8,433,000	1,479,000
Real Estate Loans | One to Four Family
Loans Receivable
Loans	168,611,000	168,611,000	179,047,000
Provision		2,762,000	2,355,000
Real Estate Loans | Multifamily
Loans Receivable
Loans	35,337,000	35,337,000	39,881,000
Provision		136,000	392,000
Real Estate Loans | Home Equity Lines of Credit
Loans Receivable
Loans	191,888,000	191,888,000	201,220,000
Provision		4,686,000	3,057,000
Commercial
Loans Receivable
Loans	174,440,000	174,440,000	177,047,000
Provision		5,419,000	4,448,000
Consumer and other
Loans Receivable
Loans	51,664,000	51,664,000	58,283,000
Provision		$ 445,000	$ 222,000