Allowance for Loan Losses - Recorded Investment in Consumer Loan Classes by Performing and Nonperforming Status (Details) - Consumer - USD ($) $ in Thousands	Mar. 31, 2017	Dec. 31, 2016
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 1,254,594	$ 1,256,024
Percentage of Total	100.00%	100.00%
Performing
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 1,242,856	$ 1,242,559
Percentage of Total	99.10%	98.90%
Nonperforming
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 11,738	$ 13,465
Percentage of Total	0.90%	1.10%
Residential Mortgage
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 700,610	$ 701,982
Percentage of Total	100.00%	100.00%
Residential Mortgage | Performing
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 692,392	$ 692,064
Percentage of Total	98.80%	98.60%
Residential Mortgage | Nonperforming
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 8,218	$ 9,918
Percentage of Total	1.20%	1.40%
Home Equity Loan
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 479,402	$ 482,284
Percentage of Total	100.00%	100.00%
Home Equity Loan | Performing
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 475,918	$ 478,845
Percentage of Total	99.30%	99.30%
Home Equity Loan | Nonperforming
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 3,484	$ 3,439
Percentage of Total	0.70%	0.70%
Installment And Other Consumer
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 70,219	$ 65,852
Percentage of Total	100.00%	100.00%
Installment And Other Consumer | Performing
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 70,183	$ 65,744
Percentage of Total	99.90%	99.80%
Installment And Other Consumer | Nonperforming
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 36	$ 108
Percentage of Total	0.10%	0.20%
Consumer Construction
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 4,363	$ 5,906
Percentage of Total	100.00%	100.00%
Consumer Construction | Performing
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 4,363	$ 5,906
Percentage of Total	100.00%	100.00%
Consumer Construction | Nonperforming
Financing Receivable, Recorded Investment [Line Items]
Loans and leases receivables, recorded investment	$ 0	$ 0
Percentage of Total	0.00%	0.00%