Allowance for Loan Losses Schedule of Delinquency Status of Loans Receivable (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2012	Dec. 31, 2011
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	$ 3,716	$ 8,058
60-89 Days Past Due	1,999	5,081
Greater Than 90 Days	0	5
Non-accrual	26,933	45,587
Total Past Due and Non-accrual	32,648	58,731
Current	660,086	652,893
Total loans receivable	692,734	711,624
Current Non-accrual Loans	6,662	7,744
One-to-four family residential
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	1,836	3,439
60-89 Days Past Due	908	1,501
Greater Than 90 Days	0	0
Non-accrual	5,671	4,935
Total Past Due and Non-accrual	8,415	9,875
Current	167,528	171,823
Total loans receivable	175,943	181,698
Current Non-accrual Loans	1,596	741
Home equity lines of credit
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	417	221
60-89 Days Past Due	0	149
Greater Than 90 Days	0	0
Non-accrual	683	541
Total Past Due and Non-accrual	1,100	911
Current	45,377	51,962
Total loans receivable	46,477	52,873
Current Non-accrual Loans	48	50
Retail construction
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	0	0
60-89 Days Past Due	0	0
Greater Than 90 Days	0	0
Non-accrual	150	169
Total Past Due and Non-accrual	150	169
Current	1,026	853
Total loans receivable	1,176	1,022
Current Non-accrual Loans	0	0
Consumer
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	12	0
60-89 Days Past Due	0	0
Greater Than 90 Days	0	0
Non-accrual	0	0
Total Past Due and Non-accrual	12	0
Current	3,293	2,771
Total loans receivable	3,305	2,771
Current Non-accrual Loans	0	0
Total retail loans
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	2,265	3,660
60-89 Days Past Due	908	1,650
Greater Than 90 Days	0	0
Non-accrual	6,504	5,645
Total Past Due and Non-accrual	9,677	10,955
Current	217,224	227,409
Total loans receivable	226,901	238,364
Current Non-accrual Loans	1,644	791
Commercial and industrial
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	152	369
60-89 Days Past Due	917	24
Greater Than 90 Days	0	0
Non-accrual	449	596
Total Past Due and Non-accrual	1,518	989
Current	101,110	84,171
Total loans receivable	102,628	85,160
Current Non-accrual Loans	228	262
Commercial real estate - owner occupied
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	426	551
60-89 Days Past Due	21	0
Greater Than 90 Days	0	0
Non-accrual	5,417	11,228
Total Past Due and Non-accrual	5,864	11,779
Current	92,182	82,054
Total loans receivable	98,046	93,833
Current Non-accrual Loans	2,976	569
Commercial real estate - non-owner occupied
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	276	1,622
60-89 Days Past Due	153	1,173
Greater Than 90 Days	0	5
Non-accrual	9,083	22,294
Total Past Due and Non-accrual	9,512	25,094
Current	154,880	163,199
Total loans receivable	164,392	188,293
Current Non-accrual Loans	1,564	6,122
Commercial real estate - multifamily
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	597	1,856
60-89 Days Past Due	0	1,732
Greater Than 90 Days	0	0
Non-accrual	2,775	91
Total Past Due and Non-accrual	3,372	3,679
Current	71,856	68,197
Total loans receivable	75,228	71,876
Current Non-accrual Loans	0	0
Commercial construction and land development
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	0	0
60-89 Days Past Due	0	502
Greater Than 90 Days	0	0
Non-accrual	2,366	3,378
Total Past Due and Non-accrual	2,366	3,880
Current	17,862	18,165
Total loans receivable	20,228	22,045
Current Non-accrual Loans	250	0
Commercial participations
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	0	0
60-89 Days Past Due	0	0
Greater Than 90 Days	0	0
Non-accrual	339	2,355
Total Past Due and Non-accrual	339	2,355
Current	4,972	9,698
Total loans receivable	5,311	12,053
Current Non-accrual Loans	0	0
Total commercial loans
Financing Receivable, Recorded Investment, Past Due [Line Items]
30-59 Days Past Due	1,451	4,398
60-89 Days Past Due	1,091	3,431
Greater Than 90 Days	0	5
Non-accrual	20,429	39,942
Total Past Due and Non-accrual	22,971	47,776
Current	442,862	425,484
Total loans receivable	465,833	473,260
Current Non-accrual Loans	$ 5,018	$ 6,953