Loans and Allowance for Loan Losses - Aging (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Dec. 31, 2016	Jun. 30, 2016
Aging categories of performing loans and nonaccrual loans
Current	$ 1,096,311	$ 1,045,208
Total Past Due	6,067	7,657
Total Loans	1,102,378	1,052,865	$ 1,087,506
Non-Accrual	5,102	6,229
90 Plus Days Still Accruing	0	0
Commercial
Aging categories of performing loans and nonaccrual loans
Current	778,148	753,561
Total Past Due	4,122	3,955
Total Loans	782,270	757,516	761,302
Non-Accrual	3,589	4,975
90 Plus Days Still Accruing	0	0
Commercial | Commercial Business
Aging categories of performing loans and nonaccrual loans
Current	377,188	387,208
Total Past Due	1,382	258
Total Loans	378,570	387,466
Non-Accrual	177	74
90 Plus Days Still Accruing	0	0
Commercial | Commercial Real Estate
Aging categories of performing loans and nonaccrual loans
Current	283,290	270,339
Total Past Due	710	1,121
Total Loans	284,000	271,460
Non-Accrual	469	1,375
90 Plus Days Still Accruing	0	0
Commercial | Acquisition & Development
Aging categories of performing loans and nonaccrual loans
Current	117,670	96,014
Total Past Due	2,030	2,576
Total Loans	119,700	98,590
Non-Accrual	2,943	3,526
90 Plus Days Still Accruing	0	0
Residential
Aging categories of performing loans and nonaccrual loans
Current	240,686	212,502
Total Past Due	1,486	2,950
Total Loans	242,172	215,452	241,920
Non-Accrual	630	1,072
90 Plus Days Still Accruing	0	0
Home Equity
Aging categories of performing loans and nonaccrual loans
Current	64,141	64,791
Total Past Due	181	595
Total Loans	64,322	65,386	68,554
Non-Accrual	616	104
90 Plus Days Still Accruing	0	0
Consumer
Aging categories of performing loans and nonaccrual loans
Current	13,336	14,354
Total Past Due	278	157
Total Loans	13,614	14,511	$ 15,730
Non-Accrual	267	78
90 Plus Days Still Accruing	0	0
Financing Receivables, 30 to 59 Days Past Due
Aging categories of performing loans and nonaccrual loans
Total Past Due	1,108	2,891
Financing Receivables, 30 to 59 Days Past Due | Commercial
Aging categories of performing loans and nonaccrual loans
Total Past Due	1,011	244
Financing Receivables, 30 to 59 Days Past Due | Commercial | Commercial Business
Aging categories of performing loans and nonaccrual loans
Total Past Due	770	15
Financing Receivables, 30 to 59 Days Past Due | Commercial | Commercial Real Estate
Aging categories of performing loans and nonaccrual loans
Total Past Due	241	229
Financing Receivables, 30 to 59 Days Past Due | Commercial | Acquisition & Development
Aging categories of performing loans and nonaccrual loans
Total Past Due	0	0
Financing Receivables, 30 to 59 Days Past Due | Residential
Aging categories of performing loans and nonaccrual loans
Total Past Due	0	2,067
Financing Receivables, 30 to 59 Days Past Due | Home Equity
Aging categories of performing loans and nonaccrual loans
Total Past Due	35	525
Financing Receivables, 30 to 59 Days Past Due | Consumer
Aging categories of performing loans and nonaccrual loans
Total Past Due	62	55
Financing Receivables, 60 to 89 Days Past Due
Aging categories of performing loans and nonaccrual loans
Total Past Due	1,577	622
Financing Receivables, 60 to 89 Days Past Due | Commercial
Aging categories of performing loans and nonaccrual loans
Total Past Due	435	169
Financing Receivables, 60 to 89 Days Past Due | Commercial | Commercial Business
Aging categories of performing loans and nonaccrual loans
Total Past Due	435	169
Financing Receivables, 60 to 89 Days Past Due | Commercial | Commercial Real Estate
Aging categories of performing loans and nonaccrual loans
Total Past Due	0	0
Financing Receivables, 60 to 89 Days Past Due | Commercial | Acquisition & Development
Aging categories of performing loans and nonaccrual loans
Total Past Due	0	0
Financing Receivables, 60 to 89 Days Past Due | Residential
Aging categories of performing loans and nonaccrual loans
Total Past Due	1,066	419
Financing Receivables, 60 to 89 Days Past Due | Home Equity
Aging categories of performing loans and nonaccrual loans
Total Past Due	76	0
Financing Receivables, 60 to 89 Days Past Due | Consumer
Aging categories of performing loans and nonaccrual loans
Total Past Due	0	34
Financing Receivables, Equal to Greater than 90 Days Past Due
Aging categories of performing loans and nonaccrual loans
Total Past Due	3,382	4,144
Financing Receivables, Equal to Greater than 90 Days Past Due | Commercial
Aging categories of performing loans and nonaccrual loans
Total Past Due	2,676	3,542
Financing Receivables, Equal to Greater than 90 Days Past Due | Commercial | Commercial Business
Aging categories of performing loans and nonaccrual loans
Total Past Due	177	74
Financing Receivables, Equal to Greater than 90 Days Past Due | Commercial | Commercial Real Estate
Aging categories of performing loans and nonaccrual loans
Total Past Due	469	892
Financing Receivables, Equal to Greater than 90 Days Past Due | Commercial | Acquisition & Development
Aging categories of performing loans and nonaccrual loans
Total Past Due	2,030	2,576
Financing Receivables, Equal to Greater than 90 Days Past Due | Residential
Aging categories of performing loans and nonaccrual loans
Total Past Due	420	464
Financing Receivables, Equal to Greater than 90 Days Past Due | Home Equity
Aging categories of performing loans and nonaccrual loans
Total Past Due	70	70
Financing Receivables, Equal to Greater than 90 Days Past Due | Consumer
Aging categories of performing loans and nonaccrual loans
Total Past Due	$ 216	$ 68