Loans and Allowance for Loan Losses - Past Due Loans (Details) - USD ($) $ in Thousands	Dec. 31, 2016	Dec. 31, 2015
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	$ 1,832,726	$ 1,680,488
Non Accruing
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	8,729	10,700
30-89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	5,749	4,988
90 Days or More and Accruing Interest
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	1,329	887
Financing Receivables Current
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	1,816,919	1,663,913
Commercial and Industrial
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	385,755	317,917
Commercial and Industrial | Non Accruing
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	1,297	1,659
Commercial and Industrial | 30-89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	262	283
Commercial and Industrial | 90 Days or More and Accruing Interest
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	127	73
Commercial and Industrial | Financing Receivables Current
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	384,069	315,902
Construction
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	241,586	231,311
Construction | Non Accruing
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	254	272
Construction | 30-89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	441	81
Construction | 90 Days or More and Accruing Interest
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	17	33
Construction | Financing Receivables Current
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	240,874	230,925
Residential Real Estate | 1-to-4 Family Mortgage
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	292,817	287,876
Residential Real Estate | 1-to-4 Family Mortgage | Non Accruing
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	2,289	2,124
Residential Real Estate | Residential Line of Credit
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	177,190	171,526
Residential Real Estate | Residential Line of Credit | Non Accruing
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	601	1,114
Residential Real Estate | Multi-Family Mortgage
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	44,949	59,474
Residential Real Estate | 30-89 Days Past Due | 1-to-4 Family Mortgage
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	3,130	2,798
Residential Real Estate | 30-89 Days Past Due | Residential Line of Credit
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	1,139	1,053
Residential Real Estate | 90 Days or More and Accruing Interest | 1-to-4 Family Mortgage
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	697	268
Residential Real Estate | 90 Days or More and Accruing Interest | Residential Line of Credit
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	433	323
Residential Real Estate | Financing Receivables Current | 1-to-4 Family Mortgage
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	286,701	282,686
Residential Real Estate | Financing Receivables Current | Residential Line of Credit
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	175,017	169,036
Residential Real Estate | Financing Receivables Current | Multi-Family Mortgage
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	44,949	59,474
Commercial Real Estate | Owner Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	353,564	332,569
Commercial Real Estate | Owner Occupied | Non Accruing
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	2,007	1,974
Commercial Real Estate | Non-Owner Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	262,562	202,192
Commercial Real Estate | Non-Owner Occupied | Non Accruing
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	2,251	3,512
Commercial Real Estate | 30-89 Days Past Due | Owner Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	186	442
Commercial Real Estate | 30-89 Days Past Due | Non-Owner Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	158
Commercial Real Estate | Financing Receivables Current | Owner Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	351,371	330,153
Commercial Real Estate | Financing Receivables Current | Non-Owner Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	260,153	198,680
Consumer and Other
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	74,303	77,623
Consumer and Other | Non Accruing
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	30	45
Consumer and Other | 30-89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	433	331
Consumer and Other | 90 Days or More and Accruing Interest
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	55	190
Consumer and Other | Financing Receivables Current
Financing Receivable Recorded Investment Past Due [Line Items]
Loans	$ 73,785	$ 77,057