Loans Receivable, Non-Performing Assets and Impaired Loans (Details) - USD ($)	3 Months Ended
	Mar. 31, 2016	Mar. 31, 2015	Dec. 31, 2015
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	$ 14,450,000		$ 16,166,000
Impaired Loans with Specific Allowance, Related Allowance	2,084,000		2,282,000
Impaired Loans with No Specific Allowance, Recorded Investment	20,015,000		20,875,000
Total Impaired Loans, Recorded Investment	34,465,000		37,041,000
Total Impaired Loans, Unpaid Principal Balance	35,918,000		38,840,000
Impaired Loans with Specific Allowance, Average Recorded Investment	14,506,000	$ 17,154,000
Impaired Loans with Specific Allowance, Interest Income Recognized	162,000	172,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	21,140,000	23,660,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	218,000	283,000
Total Impaired Loans, Average Recorded Investment	35,646,000	40,814,000
Total Impaired Loans, Interest Income Recognized	380,000	455,000
Interest income on cash basis recognized on impaired loans	380,000	455,000
Loans in nonaccrual status included in impaired loans	26,191,000
Impaired loans	34,465,000		37,041,000
Total loans	622,231,000		622,234,000
Pass [Member]
Impaired loans [Abstract]
Total loans	589,926,000		580,276,000
Residential Mortgage [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	11,386,000		11,885,000
Impaired Loans with Specific Allowance, Related Allowance	1,760,000		1,838,000
Impaired Loans with No Specific Allowance, Recorded Investment	15,091,000		14,202,000
Total Impaired Loans, Recorded Investment	26,477,000		26,087,000
Total Impaired Loans, Unpaid Principal Balance	27,159,000		26,656,000
Impaired Loans with Specific Allowance, Average Recorded Investment	11,433,000	13,648,000
Impaired Loans with Specific Allowance, Interest Income Recognized	123,000	136,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	15,217,000	15,343,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	168,000	148,000
Total Impaired Loans, Average Recorded Investment	26,650,000	28,991,000
Total Impaired Loans, Interest Income Recognized	291,000	284,000
Impaired loans	26,477,000		26,087,000
Total loans	284,701,000		285,930,000
Residential Mortgage [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	270,487,000		268,583,000
Construction Acquisition and Development [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	0		0
Impaired Loans with Specific Allowance, Related Allowance	0		0
Impaired Loans with No Specific Allowance, Recorded Investment	351,000		309,000
Total Impaired Loans, Recorded Investment	351,000		309,000
Total Impaired Loans, Unpaid Principal Balance	351,000		309,000
Impaired Loans with Specific Allowance, Average Recorded Investment	0	0
Impaired Loans with Specific Allowance, Interest Income Recognized	0	0
Impaired Loans with No Specific Allowance, Average Recorded Investment	331,000	1,157,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	4,000	9,000
Total Impaired Loans, Average Recorded Investment	331,000	1,157,000
Total Impaired Loans, Interest Income Recognized	4,000	9,000
Impaired loans	351,000		309,000
Total loans	60,053,000		77,478,000
Construction Acquisition and Development [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	59,702,000		77,168,000
Land [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	647,000		639,000
Impaired Loans with Specific Allowance, Related Allowance	81,000		78,000
Impaired Loans with No Specific Allowance, Recorded Investment	797,000		969,000
Total Impaired Loans, Recorded Investment	1,444,000		1,608,000
Total Impaired Loans, Unpaid Principal Balance	1,557,000		1,723,000
Impaired Loans with Specific Allowance, Average Recorded Investment	649,000	354,000
Impaired Loans with Specific Allowance, Interest Income Recognized	8,000	3,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	878,000	1,676,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	10,000	22,000
Total Impaired Loans, Average Recorded Investment	1,527,000	2,030,000
Total Impaired Loans, Interest Income Recognized	18,000	25,000
Impaired loans	1,444,000		1,608,000
Total loans	31,610,000		28,677,000
Land [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	30,715,000		26,845,000
Lines of Credit [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	150,000		299,000
Impaired Loans with Specific Allowance, Related Allowance	15,000		30,000
Impaired Loans with No Specific Allowance, Recorded Investment	0		0
Total Impaired Loans, Recorded Investment	150,000		299,000
Total Impaired Loans, Unpaid Principal Balance	150,000		299,000
Impaired Loans with Specific Allowance, Average Recorded Investment	150,000	0
Impaired Loans with Specific Allowance, Interest Income Recognized	2,000	0
Impaired Loans with No Specific Allowance, Average Recorded Investment	99,000	454,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	0	13,000
Total Impaired Loans, Average Recorded Investment	249,000	454,000
Total Impaired Loans, Interest Income Recognized	2,000	13,000
Impaired loans	150,000		299,000
Total loans	21,858,000		20,188,000
Lines of Credit [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	21,344,000		19,521,000
Commercial Real Estate [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	2,142,000		3,214,000
Impaired Loans with Specific Allowance, Related Allowance	221,000		328,000
Impaired Loans with No Specific Allowance, Recorded Investment	1,658,000		3,107,000
Total Impaired Loans, Recorded Investment	3,800,000		6,321,000
Total Impaired Loans, Unpaid Principal Balance	3,872,000		6,469,000
Impaired Loans with Specific Allowance, Average Recorded Investment	2,148,000	2,518,000
Impaired Loans with Specific Allowance, Interest Income Recognized	27,000	31,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	2,381,000	1,953,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	16,000	40,000
Total Impaired Loans, Average Recorded Investment	4,529,000	4,471,000
Total Impaired Loans, Interest Income Recognized	43,000	71,000
Impaired loans	3,800,000		6,321,000
Total loans	186,270,000		174,912,000
Commercial Real Estate [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	172,572,000		155,766,000
Commercial Non-Real Estate [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	99,000		103,000
Impaired Loans with Specific Allowance, Related Allowance	4,000		5,000
Impaired Loans with No Specific Allowance, Recorded Investment	0		19,000
Total Impaired Loans, Recorded Investment	99,000		122,000
Total Impaired Loans, Unpaid Principal Balance	99,000		123,000
Impaired Loans with Specific Allowance, Average Recorded Investment	100,000	270,000
Impaired Loans with Specific Allowance, Interest Income Recognized	1,000	2,000
Impaired Loans with No Specific Allowance, Average Recorded Investment	18,000	0
Impaired Loans with No Specific Allowance, Interest Income Recognized	0	13,000
Total Impaired Loans, Average Recorded Investment	118,000	270,000
Total Impaired Loans, Interest Income Recognized	1,000	15,000
Impaired loans	99,000		122,000
Total loans	13,156,000		9,296,000
Commercial Non-Real Estate [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	12,815,000		9,151,000
Home Equity [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	16,000		16,000
Impaired Loans with Specific Allowance, Related Allowance	2,000		2,000
Impaired Loans with No Specific Allowance, Recorded Investment	1,913,000		2,269,000
Total Impaired Loans, Recorded Investment	1,929,000		2,285,000
Total Impaired Loans, Unpaid Principal Balance	2,515,000		3,251,000
Impaired Loans with Specific Allowance, Average Recorded Investment	16,000	352,000
Impaired Loans with Specific Allowance, Interest Income Recognized	1,000	0
Impaired Loans with No Specific Allowance, Average Recorded Investment	2,148,000	3,077,000
Impaired Loans with No Specific Allowance, Interest Income Recognized	20,000	38,000
Total Impaired Loans, Average Recorded Investment	2,164,000	3,429,000
Total Impaired Loans, Interest Income Recognized	21,000	38,000
Impaired loans	1,929,000		2,285,000
Total loans	23,442,000		24,529,000
Home Equity [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	21,356,000		22,018,000
Consumer [Member]
Impaired loans [Abstract]
Impaired Loans with Specific Allowance, Recorded Investment	10,000		10,000
Impaired Loans with Specific Allowance, Related Allowance	1,000		1,000
Impaired Loans with No Specific Allowance, Recorded Investment	205,000		0
Total Impaired Loans, Recorded Investment	215,000		10,000
Total Impaired Loans, Unpaid Principal Balance	215,000		10,000
Impaired Loans with Specific Allowance, Average Recorded Investment	10,000	12,000
Impaired Loans with Specific Allowance, Interest Income Recognized	0	0
Impaired Loans with No Specific Allowance, Average Recorded Investment	68,000	0
Impaired Loans with No Specific Allowance, Interest Income Recognized	0	0
Total Impaired Loans, Average Recorded Investment	78,000	12,000
Total Impaired Loans, Interest Income Recognized	0	$ 0
Impaired loans	215,000		10,000
Total loans	1,141,000		1,224,000
Consumer [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	935,000		1,224,000
Residential Real Estate [Member]
Impaired loans [Abstract]
Total Impaired Loans, Recorded Investment	26,477,000
Impaired loans	26,477,000
Consumer Residential Real Estate [Member]
Impaired loans [Abstract]
Total Impaired Loans, Recorded Investment	20,821,000
Impaired loans	20,821,000
Builders Residential Real Estate [Member]
Impaired loans [Abstract]
Total Impaired Loans, Recorded Investment	5,656,000
Impaired loans	5,656,000
Unfunded [Member] | Pass [Member]
Impaired loans [Abstract]
Total loans	$ 18,220,000		$ 21,101,000