Loans and Allowance for Loan Losses - Sale of Loans Held-for-Investment (Details) (USD $)	3 Months Ended		12 Months Ended
	Dec. 31, 2012	Mar. 31, 2012	Dec. 31, 2012
Sale of loans held-for-investment [Line Items]
Gain (Loss) on Sale of Other Loans and Leases			$ 2,100,000
Financing Receivable, Recorded Investment, Loans Sold	43,209,000		43,209,000
Allowance for Doubtful Accounts Receivable, Write-offs, Loans Sold	21,715,000
Additional Provision for Loan, Lease and Other Losses, Loans Sold	18,727,000
Gain (Loss) on Sale of Loans and Leases		21,700,000
Financing Receivable, Allowance for Credit Losses, Writedowns, Other Problem Loans	10,999,000
Commercial
Sale of loans held-for-investment [Line Items]
Financing Receivable, Recorded Investment, Loans Sold	2,291,000		2,291,000
Allowance for Doubtful Accounts Receivable, Write-offs, Loans Sold	1,329,000
Additional Provision for Loan, Lease and Other Losses, Loans Sold	1,290,000
Financing Receivable, Allowance for Credit Losses, Writedowns, Other Problem Loans	3,908,000
Consumer and other
Sale of loans held-for-investment [Line Items]
Financing Receivable, Recorded Investment, Loans Sold	151,000		151,000
Allowance for Doubtful Accounts Receivable, Write-offs, Loans Sold	91,000
Additional Provision for Loan, Lease and Other Losses, Loans Sold	57,000
Financing Receivable, Allowance for Credit Losses, Writedowns, Other Problem Loans	24,000
Owner Occupied Commercial | Real Estate Loans
Sale of loans held-for-investment [Line Items]
Financing Receivable, Recorded Investment, Loans Sold	8,871,000		8,871,000
Allowance for Doubtful Accounts Receivable, Write-offs, Loans Sold	3,917,000
Additional Provision for Loan, Lease and Other Losses, Loans Sold	4,313,000
Financing Receivable, Allowance for Credit Losses, Writedowns, Other Problem Loans	1,599,000
Non-owner Occupied | Real Estate Loans
Sale of loans held-for-investment [Line Items]
Financing Receivable, Recorded Investment, Loans Sold	8,675,000		8,675,000
Allowance for Doubtful Accounts Receivable, Write-offs, Loans Sold	4,531,000
Additional Provision for Loan, Lease and Other Losses, Loans Sold	3,755,000
Financing Receivable, Allowance for Credit Losses, Writedowns, Other Problem Loans	2,267,000
One to Four Family | Real Estate Loans
Sale of loans held-for-investment [Line Items]
Financing Receivable, Recorded Investment, Loans Sold	4,557,000		4,557,000
Allowance for Doubtful Accounts Receivable, Write-offs, Loans Sold	2,825,000
Additional Provision for Loan, Lease and Other Losses, Loans Sold	2,380,000
Financing Receivable, Allowance for Credit Losses, Writedowns, Other Problem Loans	291,000
Multifamily | Real Estate Loans
Sale of loans held-for-investment [Line Items]
Financing Receivable, Recorded Investment, Loans Sold	249,000		249,000
Allowance for Doubtful Accounts Receivable, Write-offs, Loans Sold	113,000
Additional Provision for Loan, Lease and Other Losses, Loans Sold	86,000
Financing Receivable, Allowance for Credit Losses, Writedowns, Other Problem Loans	0
Home Equity Lines of Credit | Real Estate Loans
Sale of loans held-for-investment [Line Items]
Financing Receivable, Recorded Investment, Loans Sold	2,204,000		2,204,000
Allowance for Doubtful Accounts Receivable, Write-offs, Loans Sold	1,284,000
Additional Provision for Loan, Lease and Other Losses, Loans Sold	746,000
Financing Receivable, Allowance for Credit Losses, Writedowns, Other Problem Loans	1,309,000
Construction Loans | Real Estate Loans
Sale of loans held-for-investment [Line Items]
Financing Receivable, Recorded Investment, Loans Sold	16,211,000		16,211,000
Allowance for Doubtful Accounts Receivable, Write-offs, Loans Sold	7,625,000
Additional Provision for Loan, Lease and Other Losses, Loans Sold	6,100,000
Financing Receivable, Allowance for Credit Losses, Writedowns, Other Problem Loans	$ 1,601,000