Loans and Allowance for Loan Losses - Credit Quality Indicators (Details) (USD $)	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012
Credit Quality Indicators
Risk review threshold	$ 20,000
Loans	1,357,767,000	1,308,372,000
Real Estate Loans | Construction Loans
Credit Quality Indicators
Loans	131,035,000	131,981,000
Real Estate Loans | Construction Loans | High Quality
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Construction Loans | Good Quality
Credit Quality Indicators
Loans	356,000	464,000
Real Estate Loans | Construction Loans | Satisfactory
Credit Quality Indicators
Loans	22,403,000	22,284,000
Real Estate Loans | Construction Loans | Merits Attention
Credit Quality Indicators
Loans	90,343,000	78,668,000
Real Estate Loans | Construction Loans | Special Mention
Credit Quality Indicators
Loans	14,434,000	16,797,000
Real Estate Loans | Construction Loans | Substandard
Credit Quality Indicators
Loans	1,168,000	3,939,000
Real Estate Loans | Construction Loans | Substandard Impaired
Credit Quality Indicators
Loans	2,331,000	9,829,000
Real Estate Loans | Construction Loans | Doubtful
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Construction Loans | Loss
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Owner Occupied Commercial
Credit Quality Indicators
Loans	382,766,000	342,962,000
Real Estate Loans | Owner Occupied Commercial | High Quality
Credit Quality Indicators
Loans	0	119,000
Real Estate Loans | Owner Occupied Commercial | Good Quality
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Owner Occupied Commercial | Satisfactory
Credit Quality Indicators
Loans	125,560,000	115,347,000
Real Estate Loans | Owner Occupied Commercial | Merits Attention
Credit Quality Indicators
Loans	226,320,000	191,958,000
Real Estate Loans | Owner Occupied Commercial | Special Mention
Credit Quality Indicators
Loans	20,284,000	23,396,000
Real Estate Loans | Owner Occupied Commercial | Substandard
Credit Quality Indicators
Loans	4,244,000	4,286,000
Real Estate Loans | Owner Occupied Commercial | Substandard Impaired
Credit Quality Indicators
Loans	6,358,000	7,856,000
Real Estate Loans | Owner Occupied Commercial | Doubtful
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Owner Occupied Commercial | Loss
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Non-owner Occupied
Credit Quality Indicators
Loans	196,926,000	211,489,000
Real Estate Loans | Non-owner Occupied | High Quality
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Non-owner Occupied | Good Quality
Credit Quality Indicators
Loans	1,587,000	0
Real Estate Loans | Non-owner Occupied | Satisfactory
Credit Quality Indicators
Loans	47,453,000	58,577,000
Real Estate Loans | Non-owner Occupied | Merits Attention
Credit Quality Indicators
Loans	133,072,000	129,283,000
Real Estate Loans | Non-owner Occupied | Special Mention
Credit Quality Indicators
Loans	7,392,000	16,084,000
Real Estate Loans | Non-owner Occupied | Substandard
Credit Quality Indicators
Loans	2,624,000	2,136,000
Real Estate Loans | Non-owner Occupied | Substandard Impaired
Credit Quality Indicators
Loans	4,798,000	5,409,000
Real Estate Loans | Non-owner Occupied | Doubtful
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Non-owner Occupied | Loss
Credit Quality Indicators
Loans	0	0
Real Estate Loans | One to Four Family
Credit Quality Indicators
Loans	174,072,000	168,611,000
Real Estate Loans | One to Four Family | High Quality
Credit Quality Indicators
Loans	90,000	375,000
Real Estate Loans | One to Four Family | Good Quality
Credit Quality Indicators
Loans	982,000	1,301,000
Real Estate Loans | One to Four Family | Satisfactory
Credit Quality Indicators
Loans	99,578,000	95,727,000
Real Estate Loans | One to Four Family | Merits Attention
Credit Quality Indicators
Loans	62,242,000	56,629,000
Real Estate Loans | One to Four Family | Special Mention
Credit Quality Indicators
Loans	5,307,000	7,862,000
Real Estate Loans | One to Four Family | Substandard
Credit Quality Indicators
Loans	3,005,000	2,850,000
Real Estate Loans | One to Four Family | Substandard Impaired
Credit Quality Indicators
Loans	2,868,000	3,867,000
Real Estate Loans | One to Four Family | Doubtful
Credit Quality Indicators
Loans	0	0
Real Estate Loans | One to Four Family | Loss
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Multifamily
Credit Quality Indicators
Loans	41,713,000	35,337,000
Real Estate Loans | Multifamily | High Quality
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Multifamily | Good Quality
Credit Quality Indicators
Loans	957,000	0
Real Estate Loans | Multifamily | Satisfactory
Credit Quality Indicators
Loans	7,691,000	7,945,000
Real Estate Loans | Multifamily | Merits Attention
Credit Quality Indicators
Loans	31,686,000	25,681,000
Real Estate Loans | Multifamily | Special Mention
Credit Quality Indicators
Loans	551,000	571,000
Real Estate Loans | Multifamily | Substandard
Credit Quality Indicators
Loans	572,000	601,000
Real Estate Loans | Multifamily | Substandard Impaired
Credit Quality Indicators
Loans	256,000	539,000
Real Estate Loans | Multifamily | Doubtful
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Multifamily | Loss
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Home Equity Lines of Credit
Credit Quality Indicators
Loans	194,145,000	191,888,000
Real Estate Loans | Home Equity Lines of Credit | High Quality
Credit Quality Indicators
Loans	161,000	111,000
Real Estate Loans | Home Equity Lines of Credit | Good Quality
Credit Quality Indicators
Loans	6,627,000	6,756,000
Real Estate Loans | Home Equity Lines of Credit | Satisfactory
Credit Quality Indicators
Loans	118,339,000	118,497,000
Real Estate Loans | Home Equity Lines of Credit | Merits Attention
Credit Quality Indicators
Loans	61,026,000	59,568,000
Real Estate Loans | Home Equity Lines of Credit | Special Mention
Credit Quality Indicators
Loans	5,075,000	4,228,000
Real Estate Loans | Home Equity Lines of Credit | Substandard
Credit Quality Indicators
Loans	1,632,000	1,687,000
Real Estate Loans | Home Equity Lines of Credit | Substandard Impaired
Credit Quality Indicators
Loans	1,285,000	1,041,000
Real Estate Loans | Home Equity Lines of Credit | Doubtful
Credit Quality Indicators
Loans	0	0
Real Estate Loans | Home Equity Lines of Credit | Loss
Credit Quality Indicators
Loans	0	0
Commercial
Credit Quality Indicators
Loans	185,443,000	174,440,000
Commercial | High Quality
Credit Quality Indicators
Loans	2,640,000	2,430,000
Commercial | Good Quality
Credit Quality Indicators
Loans	5,084,000	5,738,000
Commercial | Satisfactory
Credit Quality Indicators
Loans	63,674,000	62,071,000
Commercial | Merits Attention
Credit Quality Indicators
Loans	94,313,000	82,243,000
Commercial | Special Mention
Credit Quality Indicators
Loans	7,874,000	16,809,000
Commercial | Substandard
Credit Quality Indicators
Loans	9,553,000	1,009,000
Commercial | Substandard Impaired
Credit Quality Indicators
Loans	2,305,000	4,140,000
Commercial | Doubtful
Credit Quality Indicators
Loans	0	0
Commercial | Loss
Credit Quality Indicators
Loans	0	0
Consumer and other
Credit Quality Indicators
Loans	51,667,000	51,664,000
Consumer and other | High Quality
Credit Quality Indicators
Loans	2,162,000	2,289,000
Consumer and other | Good Quality
Credit Quality Indicators
Loans	1,160,000	1,316,000
Consumer and other | Satisfactory
Credit Quality Indicators
Loans	21,221,000	22,459,000
Consumer and other | Merits Attention
Credit Quality Indicators
Loans	26,126,000	24,425,000
Consumer and other | Special Mention
Credit Quality Indicators
Loans	676,000	551,000
Consumer and other | Substandard
Credit Quality Indicators
Loans	32,000	122,000
Consumer and other | Substandard Impaired
Credit Quality Indicators
Loans	290,000	502,000
Consumer and other | Doubtful
Credit Quality Indicators
Loans	0	0
Consumer and other | Loss
Credit Quality Indicators
Loans	0	0
Total Loans
Credit Quality Indicators
Loans	1,357,767,000	1,308,372,000
Total Loans | High Quality
Credit Quality Indicators
Loans	5,053,000	5,324,000
Total Loans | Good Quality
Credit Quality Indicators
Loans	16,753,000	15,575,000
Total Loans | Satisfactory
Credit Quality Indicators
Loans	505,919,000	502,907,000
Total Loans | Merits Attention
Credit Quality Indicators
Loans	725,128,000	648,455,000
Total Loans | Special Mention
Credit Quality Indicators
Loans	61,593,000	86,298,000
Total Loans | Substandard
Credit Quality Indicators
Loans	22,830,000	16,630,000
Total Loans | Substandard Impaired
Credit Quality Indicators
Loans	20,491,000	33,183,000
Total Loans | Doubtful
Credit Quality Indicators
Loans	0	0
Total Loans | Loss
Credit Quality Indicators
Loans	$ 0	$ 0