Allowance for Loan Losses - Recorded Investment Segregated By Amounts Individually Or Collectively In Allowance For Loan Losses (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Dec. 31, 2016
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	$ 995,353	$ 979,449
Balance, end of period: Individually evaluated for impairment	36,311	38,656
Balance, end of period: Collectively evaluated for impairment	959,042	940,793
Commercial
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	309,493	278,178
Balance, end of period: Individually evaluated for impairment	27,545	18,657
Balance, end of period: Collectively evaluated for impairment	281,948	259,521
Real estate construction one-to-four family
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	24,714	26,061
Balance, end of period: Individually evaluated for impairment	0	0
Balance, end of period: Collectively evaluated for impairment	24,714	26,061
Real estate construction other
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	73,999	72,159
Balance, end of period: Individually evaluated for impairment	0	0
Balance, end of period: Collectively evaluated for impairment	73,999	72,159
Real estate term owner occupied
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	139,475	152,178
Balance, end of period: Individually evaluated for impairment	6,058	16,946
Balance, end of period: Collectively evaluated for impairment	133,417	135,232
Real estate term non-owner occupied
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	359,463	356,601
Balance, end of period: Individually evaluated for impairment	1,044	1,084
Balance, end of period: Collectively evaluated for impairment	358,419	355,517
Real estate term other
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	42,199	45,402
Balance, end of period: Individually evaluated for impairment	1,239	1,302
Balance, end of period: Collectively evaluated for impairment	40,960	44,100
Consumer secured by 1st deeds of trust
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	23,413	23,589
Balance, end of period: Individually evaluated for impairment	425	615
Balance, end of period: Collectively evaluated for impairment	22,988	22,974
Consumer other
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	22,597	25,281
Balance, end of period: Individually evaluated for impairment	0	52
Balance, end of period: Collectively evaluated for impairment	$ 22,597	$ 25,229