Loans and Credit Quality - Impaired Loans (Details) - USD ($)	12 Months Ended
	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	$ 33,579,000	$ 10,491,000
Impaired loan, no related allowance, unpaid principal balance	33,992,000	10,549,000
Impaired loan, related allowance, recorded investment	1,061,000	806,000
Impaired loan, related allowance, unpaid principal balance	1,061,000	806,000
Related allowance	344,000	75,000
Recorded investment	34,640,000	11,297,000
Unpaid principal balance	35,053,000	11,355,000
Impaired loan, no related allowance, average recorded investment	24,249,000	9,956,000
Impaired loan, no related allowance, interest income on accrual method	1,140,000	756,000
Impaired loan, related allowance, average recorded investment	1,748,000	577,000
Impaired loan, related allowance, interest income on accrual method	0	6,000
Impaired loan, average recorded investment	25,997,000	10,533,000	$ 10,900,000
Impaired loan, interest income on accrual method	1,140,000	762,000	$ 461,000
Commercial | Asset Quality Rating - Pass
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, average recorded investment	0	97,000
Impaired loan, no related allowance, interest income on accrual method	0	2,000
Impaired loan, average recorded investment	0	97,000
Impaired loan, interest income on accrual method	0	2,000
Commercial | Asset Quality Rating - Special Mention
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	157,000	170,000
Impaired loan, no related allowance, unpaid principal balance	157,000	170,000
Related allowance	0	0
Recorded investment	157,000	170,000
Unpaid principal balance	157,000	170,000
Impaired loan, no related allowance, average recorded investment	163,000	254,000
Impaired loan, no related allowance, interest income on accrual method	13,000	23,000
Impaired loan, related allowance, average recorded investment	0	46,000
Impaired loan, related allowance, interest income on accrual method	0	6,000
Impaired loan, average recorded investment	163,000	300,000
Impaired loan, interest income on accrual method	13,000	29,000
Commercial | Asset Quality Rating - Substandard
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	14,030,000	3,000,000
Impaired loan, no related allowance, unpaid principal balance	14,443,000	3,045,000
Impaired loan, related allowance, recorded investment	1,061,000	806,000
Impaired loan, related allowance, unpaid principal balance	1,061,000	806,000
Related allowance	344,000	75,000
Recorded investment	15,091,000	3,806,000
Unpaid principal balance	15,504,000	3,851,000
Impaired loan, no related allowance, average recorded investment	10,738,000	1,912,000
Impaired loan, no related allowance, interest income on accrual method	421,000	94,000
Impaired loan, related allowance, average recorded investment	1,668,000	356,000
Impaired loan, related allowance, interest income on accrual method	0	0
Impaired loan, average recorded investment	12,406,000	2,268,000
Impaired loan, interest income on accrual method	421,000	94,000
Real Estate Construction One-To- Four Family | Asset Quality Rating - Special Mention
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment		191,000
Impaired loan, no related allowance, unpaid principal balance		191,000
Related allowance		0
Recorded investment		191,000
Unpaid principal balance		191,000
Impaired loan, no related allowance, average recorded investment	0	175,000
Impaired loan, no related allowance, interest income on accrual method	0	11,000
Impaired loan, average recorded investment	0	175,000
Impaired loan, interest income on accrual method	0	11,000
Real Estate Construction One-To- Four Family | Asset Quality Rating - Substandard
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, average recorded investment	0	117,000
Impaired loan, no related allowance, interest income on accrual method	0	0
Impaired loan, average recorded investment	0	117,000
Impaired loan, interest income on accrual method	0	0
Real Estate Construction Other | Asset Quality Rating - Pass
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment		772,000
Impaired loan, no related allowance, unpaid principal balance		772,000
Related allowance		0
Recorded investment		772,000
Unpaid principal balance		772,000
Impaired loan, no related allowance, average recorded investment	557,000	196,000
Impaired loan, no related allowance, interest income on accrual method	72,000	30,000
Impaired loan, average recorded investment	557,000	196,000
Impaired loan, interest income on accrual method	72,000	30,000
Real Estate Construction Other | Asset Quality Rating - Special Mention
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, average recorded investment	0	605,000
Impaired loan, no related allowance, interest income on accrual method	0	101,000
Impaired loan, average recorded investment	0	605,000
Impaired loan, interest income on accrual method	0	101,000
Real Estate Construction Other | Asset Quality Rating - Substandard
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, average recorded investment	1,431,000	0
Impaired loan, no related allowance, interest income on accrual method	0	0
Impaired loan, average recorded investment	1,431,000	0
Impaired loan, interest income on accrual method	0	0
Real Estate Term Owner Occupied | Asset Quality Rating - Pass
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	753,000	501,000
Impaired loan, no related allowance, unpaid principal balance	753,000	501,000
Related allowance	0	0
Recorded investment	753,000	501,000
Unpaid principal balance	753,000	501,000
Impaired loan, no related allowance, average recorded investment	696,000	507,000
Impaired loan, no related allowance, interest income on accrual method	63,000	50,000
Impaired loan, average recorded investment	696,000	507,000
Impaired loan, interest income on accrual method	63,000	50,000
Real Estate Term Owner Occupied | Asset Quality Rating - Special Mention
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment		273,000
Impaired loan, no related allowance, unpaid principal balance		273,000
Related allowance		0
Recorded investment		273,000
Unpaid principal balance		273,000
Impaired loan, no related allowance, average recorded investment	67,000	299,000
Impaired loan, no related allowance, interest income on accrual method	5,000	20,000
Impaired loan, average recorded investment	67,000	299,000
Impaired loan, interest income on accrual method	5,000	20,000
Real Estate Term Owner Occupied | Asset Quality Rating - Substandard
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	16,476,000	558,000
Impaired loan, no related allowance, unpaid principal balance	16,476,000	558,000
Related allowance	0	0
Recorded investment	16,476,000	558,000
Unpaid principal balance	16,476,000	558,000
Impaired loan, no related allowance, average recorded investment	6,941,000	1,018,000
Impaired loan, no related allowance, interest income on accrual method	355,000	60,000
Impaired loan, average recorded investment	6,941,000	1,018,000
Impaired loan, interest income on accrual method	355,000	60,000
Real Estate Term Non-Owner Occupied | Asset Quality Rating - Pass
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	473,000	549,000
Impaired loan, no related allowance, unpaid principal balance	473,000	549,000
Related allowance	0	0
Recorded investment	473,000	549,000
Unpaid principal balance	473,000	549,000
Impaired loan, no related allowance, average recorded investment	521,000	595,000
Impaired loan, no related allowance, interest income on accrual method	75,000	94,000
Impaired loan, average recorded investment	521,000	595,000
Impaired loan, interest income on accrual method	75,000	94,000
Real Estate Term Non-Owner Occupied | Asset Quality Rating - Special Mention
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment		2,088,000
Impaired loan, no related allowance, unpaid principal balance		2,088,000
Related allowance		0
Recorded investment		2,088,000
Unpaid principal balance		2,088,000
Impaired loan, no related allowance, average recorded investment	1,080,000	2,360,000
Impaired loan, no related allowance, interest income on accrual method	97,000	253,000
Impaired loan, average recorded investment	1,080,000	2,360,000
Impaired loan, interest income on accrual method	97,000	253,000
Real Estate Term Non-Owner Occupied | Asset Quality Rating - Substandard
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	352,000	1,709,000
Impaired loan, no related allowance, unpaid principal balance	352,000	1,709,000
Related allowance	0	0
Recorded investment	352,000	1,709,000
Unpaid principal balance	352,000	1,709,000
Impaired loan, no related allowance, average recorded investment	1,141,000	1,229,000
Impaired loan, no related allowance, interest income on accrual method	0	0
Impaired loan, average recorded investment	1,141,000	1,229,000
Impaired loan, interest income on accrual method	0	0
Real Estate Term Other | Asset Quality Rating - Pass
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	699,000
Impaired loan, no related allowance, unpaid principal balance	699,000
Related allowance	0
Recorded investment	699,000
Unpaid principal balance	699,000
Impaired loan, no related allowance, average recorded investment	179,000	0
Impaired loan, no related allowance, interest income on accrual method	13,000	0
Impaired loan, average recorded investment	179,000	0
Impaired loan, interest income on accrual method	13,000	0
Real Estate Term Other | Asset Quality Rating - Special Mention
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	91,000
Impaired loan, no related allowance, unpaid principal balance	91,000
Related allowance	0
Recorded investment	91,000
Unpaid principal balance	91,000
Impaired loan, no related allowance, average recorded investment	68,000	0
Impaired loan, no related allowance, interest income on accrual method	6,000	0
Impaired loan, average recorded investment	68,000	0
Impaired loan, interest income on accrual method	6,000	0
Real Estate Term Other | Asset Quality Rating - Substandard
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment		150,000
Impaired loan, no related allowance, unpaid principal balance		150,000
Related allowance		0
Recorded investment		150,000
Unpaid principal balance		150,000
Impaired loan, no related allowance, average recorded investment	74,000	152,000
Impaired loan, no related allowance, interest income on accrual method	7,000	14,000
Impaired loan, related allowance, average recorded investment	70,000	0
Impaired loan, related allowance, interest income on accrual method	0	0
Impaired loan, average recorded investment	144,000	152,000
Impaired loan, interest income on accrual method	7,000	14,000
Consumer Secured By 1st Deed Of Trust | Asset Quality Rating - Pass
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	76,000	82,000
Impaired loan, no related allowance, unpaid principal balance	76,000	82,000
Related allowance	0	0
Recorded investment	76,000	82,000
Unpaid principal balance	76,000	82,000
Impaired loan, no related allowance, average recorded investment	79,000	85,000
Impaired loan, no related allowance, interest income on accrual method	4,000	4,000
Impaired loan, average recorded investment	79,000	85,000
Impaired loan, interest income on accrual method	4,000	4,000
Consumer Secured By 1st Deed Of Trust | Asset Quality Rating - Special Mention
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment		448,000
Impaired loan, no related allowance, unpaid principal balance		461,000
Related allowance	0	0
Recorded investment	472,000	448,000
Unpaid principal balance	472,000	461,000
Consumer Secured By 1st Deed Of Trust | Asset Quality Rating - Substandard
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, recorded investment	472,000
Impaired loan, no related allowance, unpaid principal balance	472,000
Impaired loan, no related allowance, average recorded investment	514,000	326,000
Impaired loan, no related allowance, interest income on accrual method	9,000	0
Impaired loan, related allowance, average recorded investment	0	175,000
Impaired loan, related allowance, interest income on accrual method	0	0
Impaired loan, average recorded investment	514,000	501,000
Impaired loan, interest income on accrual method	9,000	0
Consumer Other | Asset Quality Rating - Substandard
Financing Receivable, Impaired [Line Items]
Impaired loan, no related allowance, average recorded investment	0	29,000
Impaired loan, no related allowance, interest income on accrual method	0	0
Impaired loan, related allowance, average recorded investment	10,000	0
Impaired loan, related allowance, interest income on accrual method	0	0
Impaired loan, average recorded investment	10,000	29,000
Impaired loan, interest income on accrual method	$ 0	$ 0