Loans and Allowance for Loan Losses - Credit Quality Indicators by Portfolio Class (Details) - USD ($) $ in Thousands	Sep. 30, 2016	Dec. 31, 2015
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	$ 1,793,343	$ 1,701,863
Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	1,708,207	1,605,904
Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	45,080	47,430
Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	40,056	48,529
Commercial and Industrial
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	370,379	317,038
Commercial and Industrial | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	357,447	310,125
Commercial and Industrial | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	8,769	1,060
Commercial and Industrial | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	4,163	5,853
Construction
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	227,321	231,025
Construction | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	219,155	219,684
Construction | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	3,053	3,238
Construction | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	5,113	8,103
Residential Real Estate | 1-to-4 Family Mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	286,580	287,749
Residential Real Estate | 1-to-4 Family Mortgage | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	269,839	268,046
Residential Real Estate | 1-to-4 Family Mortgage | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	6,605	9,367
Residential Real Estate | 1-to-4 Family Mortgage | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	10,136	10,336
Residential Real Estate | Residential Line of Credit
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	173,898	171,526
Residential Real Estate | Residential Line of Credit | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	169,686	165,838
Residential Real Estate | Residential Line of Credit | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	2,298	3,069
Residential Real Estate | Residential Line of Credit | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	1,914	2,619
Residential Real Estate | Multi-Family Mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	54,129	59,510
Residential Real Estate | Multi-Family Mortgage | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	52,910	58,234
Residential Real Estate | Multi-Family Mortgage | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	155	166
Residential Real Estate | Multi-Family Mortgage | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	1,064	1,110
Commercial Real Estate | Owner Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	350,790	330,207
Commercial Real Estate | Owner Occupied | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	331,746	310,538
Commercial Real Estate | Owner Occupied | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	10,661	9,852
Commercial Real Estate | Owner Occupied | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	8,383	9,817
Commercial Real Estate | Non-Owner Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	265,190	237,222
Commercial Real Estate | Non-Owner Occupied | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	243,161	206,645
Commercial Real Estate | Non-Owner Occupied | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	13,080	20,218
Commercial Real Estate | Non-Owner Occupied | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	8,949	10,359
Consumer and Other
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	65,056	67,586
Consumer and Other | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	64,263	66,794
Consumer and Other | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	459	460
Consumer and Other | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	$ 334	$ 332