Loans and Allowance for Loan Losses - Loans Receivable (Details) (USD $)	3 Months Ended				9 Months Ended																			9 Months Ended
	Sep. 30, 2012	Dec. 31, 2011		Sep. 30, 2011	Sep. 30, 2012 Non-owner Occupied	Sep. 30, 2012 Real Estate Loans Construction Loans	Dec. 31, 2011 Real Estate Loans Construction Loans	Sep. 30, 2012 Real Estate Loans Commercial Real Estate	Dec. 31, 2011 Real Estate Loans Commercial Real Estate	Sep. 30, 2012 Real Estate Loans Owner Occupied	Dec. 31, 2011 Real Estate Loans Owner Occupied	Sep. 30, 2012 Real Estate Loans Non-owner Occupied	Dec. 31, 2011 Real Estate Loans Non-owner Occupied	Sep. 30, 2012 Real Estate Loans One to Four Family	Dec. 31, 2011 Real Estate Loans One to Four Family	Sep. 30, 2012 Real Estate Loans Multifamily	Dec. 31, 2011 Real Estate Loans Multifamily	Sep. 30, 2012 Real Estate Loans Home Equity Lines of Credit	Dec. 31, 2011 Real Estate Loans Home Equity Lines of Credit	Sep. 30, 2012 Commercial	Dec. 31, 2011 Commercial	Sep. 30, 2012 Consumer and other	Dec. 31, 2011 Consumer and other	Sep. 30, 2012 Transferred Loan 1 Non-owner Occupied
Loans Receivable
Loans	$ 1,357,640,000	$ 1,450,039,000				$ 147,408,000	$ 202,803,000	$ 577,800,000	$ 591,800,000	$ 346,908,000	$ 348,931,000	$ 230,854,000	$ 242,827,000	$ 174,712,000	$ 179,047,000	$ 37,987,000	$ 39,881,000	$ 196,489,000	$ 201,220,000	$ 168,510,000	$ 177,047,000	$ 54,772,000	$ 58,283,000
Less: Net deferred loan origination fees	1,228,000	885,000
Allowance for loan losses	(27,231,000)	(32,848,000)	[1]
Net loans	1,331,637,000	1,418,076,000	[1]	1,439,927,000
Loans transferred from construction loans to permanent commercial real estate loans	25,300,000
Transfer from loans held-for-investment to loans held-for-sale					8,400,000																			7,600,000
Transfer of loans to held-for-sale, amount charged off to record loan at fair value					$ 4,300,000

[1] Derived from audited consolidated financial statements