Loans Receivable, Non-Performing Assets and Impaired Loans (Details) - USD ($)	3 Months Ended		9 Months Ended
	Sep. 30, 2016	Sep. 30, 2015	Sep. 30, 2016	Sep. 30, 2015	Dec. 31, 2015
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	$ 14,067,000		$ 14,067,000		$ 16,166,000
Impaired Loans with Specific Allowance, Related Allowance	2,259,000		2,259,000		2,282,000
Impaired Loans with No Specific Allowance, Recorded Investment	19,710,000		19,710,000		20,875,000
Total Impaired Loans, Recorded Investment	33,777,000		33,777,000		37,041,000
Total Impaired Loans, Unpaid Principal Balance	35,295,000		35,295,000		38,840,000
Impaired Loans with Specific Allowance, Average Recorded Investment	13,563,000	$ 17,268,000	13,862,000	$ 16,868,000
Impaired Loans with Specific Allowance, Interest Income Recognized	146,000	184,000	469,000	515,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	19,680,000	18,829,000	22,024,000	21,364,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	218,000	213,000	649,000	749,000
Total Impaired Loans, Average Recorded Investment	33,243,000	36,097,000	35,886,000	38,232,000
Total Impaired Loans, Interest Income Recognized	364,000	397,000	1,118,000	1,264,000
Interest income on cash basis recognized on impaired loans	364,000	397,000	1,118,000	1,264,000
Loans in nonaccrual status included in impaired loans	25,571,000		25,571,000
Impaired loans	33,777,000		33,777,000		37,041,000
Total loans	632,886,000		632,886,000		622,234,000
Pass [Member]
Impaired loans [Abstract]
Total loans	605,291,000		605,291,000		580,276,000
Residential Mortgage [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	9,812,000		9,812,000		11,885,000
Impaired Loans with Specific Allowance, Related Allowance	1,583,000		1,583,000		1,838,000
Impaired Loans with No Specific Allowance, Recorded Investment	12,709,000		12,709,000		14,202,000
Total Impaired Loans, Recorded Investment	22,521,000		22,521,000		26,087,000
Total Impaired Loans, Unpaid Principal Balance	23,138,000		23,138,000		26,656,000
Impaired Loans with Specific Allowance, Average Recorded Investment	9,831,000	12,848,000	10,684,000	12,438,000
Impaired Loans with Specific Allowance, Interest Income Recognized	106,000	137,000	356,000	402,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	12,734,000	12,512,000	13,774,000	14,101,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	132,000	125,000	417,000	422,000
Total Impaired Loans, Average Recorded Investment	22,565,000	25,360,000	24,458,000	26,539,000
Total Impaired Loans, Interest Income Recognized	238,000	262,000	773,000	824,000
Impaired loans	22,521,000		22,521,000		26,087,000
Total loans	271,924,000		271,924,000		285,930,000
Residential Mortgage [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	261,922,000		261,922,000		268,583,000
Construction Acquisition and Development [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	0		0		0
Impaired Loans with Specific Allowance, Related Allowance	0		0		0
Impaired Loans with No Specific Allowance, Recorded Investment	71,000		71,000		309,000
Total Impaired Loans, Recorded Investment	71,000		71,000		309,000
Total Impaired Loans, Unpaid Principal Balance	71,000		71,000		309,000
Impaired Loans with Specific Allowance, Average Recorded Investment	0	125,000	0	125,000
Impaired Loans with Specific Allowance, Interest Income Recognized	0	1,000	0	1,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	71,000	413,000	269,000	623,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	1,000	6,000	9,000	23,000
Total Impaired Loans, Average Recorded Investment	71,000	538,000	269,000	748,000
Total Impaired Loans, Interest Income Recognized	1,000	7,000	9,000	24,000
Impaired loans	71,000		71,000		309,000
Total loans	63,879,000		63,879,000		77,478,000
Construction Acquisition and Development [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	63,533,000		63,533,000		77,168,000
Land [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	424,000		424,000		639,000
Impaired Loans with Specific Allowance, Related Allowance	55,000		55,000		78,000
Impaired Loans with No Specific Allowance, Recorded Investment	951,000		951,000		969,000
Total Impaired Loans, Recorded Investment	1,375,000		1,375,000		1,608,000
Total Impaired Loans, Unpaid Principal Balance	1,488,000		1,488,000		1,723,000
Impaired Loans with Specific Allowance, Average Recorded Investment	426,000	821,000	513,000	843,000
Impaired Loans with Specific Allowance, Interest Income Recognized	6,000	8,000	20,000	14,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	960,000	1,075,000	1,162,000	1,118,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	8,000	16,000	27,000	60,000
Total Impaired Loans, Average Recorded Investment	1,386,000	1,896,000	1,675,000	1,961,000
Total Impaired Loans, Interest Income Recognized	14,000	24,000	47,000	74,000
Impaired loans	1,375,000		1,375,000		1,608,000
Total loans	34,861,000		34,861,000		28,677,000
Land [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	33,683,000		33,683,000		26,845,000
Lines of Credit [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	149,000		149,000		299,000
Impaired Loans with Specific Allowance, Related Allowance	15,000		15,000		30,000
Impaired Loans with No Specific Allowance, Recorded Investment	346,000		346,000		0
Total Impaired Loans, Recorded Investment	495,000		495,000		299,000
Total Impaired Loans, Unpaid Principal Balance	495,000		495,000		299,000
Impaired Loans with Specific Allowance, Average Recorded Investment	149,000	0	149,000	0
Impaired Loans with Specific Allowance, Interest Income Recognized	2,000	0	6,000	0
Impaired Loans with No Specific Allowance, Average Recorded Investment	274,000	278,000	144,000	395,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	2,000	2,000	3,000	17,000
Total Impaired Loans, Average Recorded Investment	423,000	278,000	293,000	395,000
Total Impaired Loans, Interest Income Recognized	4,000	2,000	9,000	17,000
Impaired loans	495,000		495,000		299,000
Total loans	26,254,000		26,254,000		20,188,000
Lines of Credit [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	25,813,000		25,813,000		19,521,000
Commercial Real Estate [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	1,973,000		1,973,000		3,214,000
Impaired Loans with Specific Allowance, Related Allowance	200,000		200,000		328,000
Impaired Loans with No Specific Allowance, Recorded Investment	3,723,000		3,723,000		3,107,000
Total Impaired Loans, Recorded Investment	5,696,000		5,696,000		6,321,000
Total Impaired Loans, Unpaid Principal Balance	5,898,000		5,898,000		6,469,000
Impaired Loans with Specific Allowance, Average Recorded Investment	1,977,000	3,241,000	2,040,000	2,754,000
Impaired Loans with Specific Allowance, Interest Income Recognized	25,000	37,000	77,000	94,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	3,730,000	1,866,000	4,655,000	1,942,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	57,000	39,000	134,000	121,000
Total Impaired Loans, Average Recorded Investment	5,707,000	5,107,000	6,695,000	4,696,000
Total Impaired Loans, Interest Income Recognized	82,000	76,000	211,000	215,000
Impaired loans	5,696,000		5,696,000		6,321,000
Total loans	198,915,000		198,915,000		174,912,000
Commercial Real Estate [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	187,060,000		187,060,000		155,766,000
Commercial Non-Real Estate [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	0		0		103,000
Impaired Loans with Specific Allowance, Related Allowance	0		0		5,000
Impaired Loans with No Specific Allowance, Recorded Investment	0		0		19,000
Total Impaired Loans, Recorded Investment	0		0		122,000
Total Impaired Loans, Unpaid Principal Balance	0		0		123,000
Impaired Loans with Specific Allowance, Average Recorded Investment	0	210,000	33,000	249,000
Impaired Loans with Specific Allowance, Interest Income Recognized	0	1,000	1,000	4,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	0	20,000	6,000	7,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	0	0	0	13,000
Total Impaired Loans, Average Recorded Investment	0	230,000	39,000	256,000
Total Impaired Loans, Interest Income Recognized	0	1,000	1,000	17,000
Impaired loans	0		0		122,000
Total loans	16,105,000		16,105,000		9,296,000
Commercial Non-Real Estate [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	15,782,000		15,782,000		9,151,000
Home Equity [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	1,609,000		1,609,000		16,000
Impaired Loans with Specific Allowance, Related Allowance	402,000		402,000		2,000
Impaired Loans with No Specific Allowance, Recorded Investment	1,910,000		1,910,000		2,269,000
Total Impaired Loans, Recorded Investment	3,519,000		3,519,000		2,285,000
Total Impaired Loans, Unpaid Principal Balance	4,105,000		4,105,000		3,251,000
Impaired Loans with Specific Allowance, Average Recorded Investment	1,078,000	12,000	370,000	448,000
Impaired Loans with Specific Allowance, Interest Income Recognized	6,000	0	7,000	0
Impaired Loans with No Specific Allowance, Average Recorded Investment	1,911,000	2,663,000	1,991,000	2,627,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	18,000	25,000	59,000	90,000
Total Impaired Loans, Average Recorded Investment	2,989,000	2,675,000	2,361,000	3,075,000
Total Impaired Loans, Interest Income Recognized	24,000	25,000	66,000	90,000
Impaired loans	3,519,000		3,519,000		2,285,000
Total loans	19,739,000		19,739,000		24,529,000
Home Equity [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	16,289,000		16,289,000		22,018,000
Consumer [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	100,000		100,000		10,000
Impaired Loans with Specific Allowance, Related Allowance	4,000		4,000		1,000
Impaired Loans with No Specific Allowance, Recorded Investment	0		0		0
Total Impaired Loans, Recorded Investment	100,000		100,000		10,000
Total Impaired Loans, Unpaid Principal Balance	100,000		100,000		10,000
Impaired Loans with Specific Allowance, Average Recorded Investment	102,000	11,000	73,000	11,000
Impaired Loans with Specific Allowance, Interest Income Recognized	1,000	0	2,000	0
Impaired Loans with No Specific Allowance, Average Recorded Investment	0	2,000	23,000	551,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	0	0	0	3,000
Total Impaired Loans, Average Recorded Investment	102,000	13,000	96,000	562,000
Total Impaired Loans, Interest Income Recognized	1,000	$ 0	2,000	$ 3,000
Impaired loans	100,000		100,000		10,000
Total loans	1,209,000		1,209,000		1,224,000
Consumer [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	1,209,000		1,209,000		1,224,000
Residential Real Estate [Member]
Impaired loans [Abstract]
Total Impaired Loans, Recorded Investment	22,521,000		22,521,000
Impaired loans	22,521,000		22,521,000
Consumer Residential Real Estate [Member]
Impaired loans [Abstract]
Total Impaired Loans, Recorded Investment	17,631,000		17,631,000
Impaired loans	17,631,000		17,631,000
Builders Residential Real Estate [Member]
Impaired loans [Abstract]
Total Impaired Loans, Recorded Investment	4,890,000		4,890,000
Impaired loans	4,890,000		4,890,000
Unfunded [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	$ 17,400,000		$ 17,400,000		$ 21,101,000