Loans and Allowance for Loan Losses - Impaired Loans (Details) (USD $)	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012
Impaired Loans
Theshold for individual impairment evaluation	$ 250,000
Impaired loans with a related allowance for loan losses, related allowance	557,000	1,397,000
Total impaired loans, recorded investment	24,526,000	33,554,000
Total impaired loans, unpaid principal balance	25,911,000	36,561,000
Total impaired loans, average recorded investment	29,425,000	65,148,000
Total impaired loans, interest income recognized	914,000	1,400,000
Allowance for loan losses	18,063,000	25,149,000
Outstanding balance of purchased impaired loans	90,741
Impaired financing receivable collectively evaluated for impairment	6,200,000	7,800,000
Impaired Financing Receivables, Allowance For Credit Losses, Collectively Evaluated For Impairment	2,100,000	2,200,000
Allowance for Purchased Impaired Loans Excess Credit Discount
Impaired Loans
Allowance for loan losses	3,567	6,672
Real Estate Loans | Construction Loans
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	2,816,000	6,212,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	2,997,000	7,676,000
Impaired loans without a related allowance for loan losses, average recorded investment	4,764,000	18,748,000
Impaired loans without a related allowance for loan losses, interest income recognized	107,000	307,000
Impaired loans with a related allowance for loan losses, recorded investment	200,000	1,958,000
Impaired loans with a related allowance for loan losses, unpaid principal balance	215,000	2,136,000
Impaired loans with a related allowance for loan losses, related allowance	40,000	191,000
Impaired loans with a related allowance for loan losses, average recorded investment	915,000	2,929,000
Impaired loans with a related allowance for loan losses, interest income recognized	25,000	4,000
Total impaired loans, recorded investment	3,016,000	8,170,000
Total impaired loans, unpaid principal balance	3,212,000	9,812,000
Total impaired loans, average recorded investment	5,679,000	21,677,000
Total impaired loans, interest income recognized	132,000	311,000
Real Estate Loans | Owner Occupied Commercial
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	5,445,000	6,563,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	5,981,000	7,071,000
Impaired loans without a related allowance for loan losses, average recorded investment	4,449,000	15,175,000
Impaired loans without a related allowance for loan losses, interest income recognized	117,000	228,000
Impaired loans with a related allowance for loan losses, recorded investment	5,131,000	4,961,000
Impaired loans with a related allowance for loan losses, unpaid principal balance	5,172,000	5,082,000
Impaired loans with a related allowance for loan losses, related allowance	201,000	189,000
Impaired loans with a related allowance for loan losses, average recorded investment	6,380,000	5,163,000
Impaired loans with a related allowance for loan losses, interest income recognized	237,000	326,000
Total impaired loans, recorded investment	10,576,000	11,524,000
Total impaired loans, unpaid principal balance	11,153,000	12,153,000
Total impaired loans, average recorded investment	10,829,000	20,338,000
Total impaired loans, interest income recognized	354,000	554,000
Real Estate Loans | Non-owner Occupied
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	4,469,000	4,976,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	4,537,000	5,358,000
Impaired loans without a related allowance for loan losses, average recorded investment	5,202,000	7,399,000
Impaired loans without a related allowance for loan losses, interest income recognized	210,000	254,000
Impaired loans with a related allowance for loan losses, recorded investment	645,000	561,000
Impaired loans with a related allowance for loan losses, unpaid principal balance	645,000	643,000
Impaired loans with a related allowance for loan losses, related allowance	50,000	89,000
Impaired loans with a related allowance for loan losses, average recorded investment	399,000	2,212,000
Impaired loans with a related allowance for loan losses, interest income recognized	10,000	63,000
Total impaired loans, recorded investment	5,114,000	5,537,000
Total impaired loans, unpaid principal balance	5,182,000	6,001,000
Total impaired loans, average recorded investment	5,601,000	9,611,000
Total impaired loans, interest income recognized	220,000	317,000
Real Estate Loans | One to Four Family
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	661,000	1,435,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	731,000	1,503,000
Impaired loans without a related allowance for loan losses, average recorded investment	692,000	2,364,000
Impaired loans without a related allowance for loan losses, interest income recognized	29,000	42,000
Impaired loans with a related allowance for loan losses, recorded investment	331,000	0
Impaired loans with a related allowance for loan losses, unpaid principal balance	341,000	0
Impaired loans with a related allowance for loan losses, related allowance	161,000	0
Impaired loans with a related allowance for loan losses, average recorded investment	442,000	347,000
Impaired loans with a related allowance for loan losses, interest income recognized	4,000	10,000
Total impaired loans, recorded investment	992,000	1,435,000
Total impaired loans, unpaid principal balance	1,072,000	1,503,000
Total impaired loans, average recorded investment	1,134,000	2,711,000
Total impaired loans, interest income recognized	33,000	52,000
Real Estate Loans | Multifamily
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	0	530,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	0	565,000
Impaired loans without a related allowance for loan losses, average recorded investment	197,000	701,000
Impaired loans without a related allowance for loan losses, interest income recognized	0	0
Impaired loans with a related allowance for loan losses, recorded investment	0	0
Impaired loans with a related allowance for loan losses, unpaid principal balance	0	0
Impaired loans with a related allowance for loan losses, related allowance	0	0
Impaired loans with a related allowance for loan losses, average recorded investment	0	0
Impaired loans with a related allowance for loan losses, interest income recognized	0	2,000
Total impaired loans, recorded investment	0	530,000
Total impaired loans, unpaid principal balance	0	565,000
Total impaired loans, average recorded investment	197,000	701,000
Total impaired loans, interest income recognized	0	2,000
Real Estate Loans | Home Equity Lines of Credit
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	425,000	705,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	477,000	800,000
Impaired loans without a related allowance for loan losses, average recorded investment	454,000	1,424,000
Impaired loans without a related allowance for loan losses, interest income recognized	0	13,000
Impaired loans with a related allowance for loan losses, recorded investment	0	0
Impaired loans with a related allowance for loan losses, unpaid principal balance	0	0
Impaired loans with a related allowance for loan losses, related allowance	0	0
Impaired loans with a related allowance for loan losses, average recorded investment	400,000	36,000
Impaired loans with a related allowance for loan losses, interest income recognized	2,000	0
Total impaired loans, recorded investment	425,000	705,000
Total impaired loans, unpaid principal balance	477,000	800,000
Total impaired loans, average recorded investment	854,000	1,460,000
Total impaired loans, interest income recognized	2,000	13,000
Commercial
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	4,095,000	4,460,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	4,502,000	4,482,000
Impaired loans without a related allowance for loan losses, average recorded investment	4,416,000	6,350,000
Impaired loans without a related allowance for loan losses, interest income recognized	171,000	143,000
Impaired loans with a related allowance for loan losses, recorded investment	308,000	1,193,000
Impaired loans with a related allowance for loan losses, unpaid principal balance	313,000	1,245,000
Impaired loans with a related allowance for loan losses, related allowance	105,000	928,000
Impaired loans with a related allowance for loan losses, average recorded investment	715,000	2,249,000
Impaired loans with a related allowance for loan losses, interest income recognized	2,000	8,000
Total impaired loans, recorded investment	4,403,000	5,653,000
Total impaired loans, unpaid principal balance	4,815,000	5,727,000
Total impaired loans, average recorded investment	5,131,000	8,599,000
Total impaired loans, interest income recognized	173,000	151,000
Consumer and other
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	0	0
Impaired loans without a related allowance for loan losses, unpaid principal balance	0	0
Impaired loans without a related allowance for loan losses, average recorded investment	0	0
Impaired loans without a related allowance for loan losses, interest income recognized	0	0
Impaired loans with a related allowance for loan losses, recorded investment	0	0
Impaired loans with a related allowance for loan losses, unpaid principal balance	0	0
Impaired loans with a related allowance for loan losses, related allowance	0	0
Impaired loans with a related allowance for loan losses, average recorded investment	0	51,000
Impaired loans with a related allowance for loan losses, interest income recognized	0	0
Total impaired loans, recorded investment	0	0
Total impaired loans, unpaid principal balance	0	0
Total impaired loans, average recorded investment	0	51,000
Total impaired loans, interest income recognized	$ 0	$ 0