Loans and Allowance for Loan Losses - Credit Quality Indicators by Portfolio Class (Details) - USD ($) $ in Thousands	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	$ 1,848,784	$ 1,701,863	$ 1,415,896
Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	1,744,392	1,605,904
Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	65,807	47,430
Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	38,585	48,529
Commercial and Industrial
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	386,233	318,791	265,818
Commercial and Industrial | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	351,046	310,997
Commercial and Industrial | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	31,074	2,166
Commercial and Industrial | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	4,113	5,628
Construction
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	245,905	238,170	165,957
Construction | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	236,588	226,829
Construction | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	4,612	3,238
Construction | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	4,705	8,103
Residential Real Estate | 1-to-4 Family Mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	294,924	290,704	266,641
Residential Real Estate | Residential Line of Credit
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	177,190	171,526	159,868
Residential Real Estate | Multi-Family Mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	44,977	59,510	52,238
Residential Real Estate | Pass | 1-to-4 Family Mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	277,948	271,001
Residential Real Estate | Pass | Residential Line of Credit
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	173,011	165,838
Residential Real Estate | Pass | Multi-Family Mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	43,770	58,234
Residential Real Estate | Watch | 1-to-4 Family Mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	6,945	9,367
Residential Real Estate | Watch | Residential Line of Credit
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	1,875	3,069
Residential Real Estate | Watch | Multi-Family Mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	152	166
Residential Real Estate | Substandard | 1-to-4 Family Mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	10,031	10,336
Residential Real Estate | Substandard | Residential Line of Credit
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	2,304	2,619
Residential Real Estate | Substandard | Multi-Family Mortgage
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	1,055	1,110
Commercial Real Estate | Owner Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	357,346	337,664	291,161
Commercial Real Estate | Non-Owner Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	267,902	207,871	151,980
Commercial Real Estate | Pass | Owner Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	338,698	318,221
Commercial Real Estate | Pass | Non-Owner Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	249,877	178,269
Commercial Real Estate | Watch | Owner Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	10,459	8,789
Commercial Real Estate | Watch | Non-Owner Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	10,273	20,158
Commercial Real Estate | Substandard | Owner Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	8,189	10,654
Commercial Real Estate | Substandard | Non-Owner Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	7,752	9,444
Consumer and Other
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	74,307	77,627	$ 62,233
Consumer and Other | Pass
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	73,454	76,515
Consumer and Other | Watch
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	417	477
Consumer and Other | Substandard
Financing Receivable Allowance For Credit Losses [Line Items]
Gross loans	$ 436	$ 635