Allowance for Loan Losses - Recorded Investment Segregated By Amounts Individually Or Collectively In Allowance For Loan Losses (Details) - USD ($) $ in Thousands	Sep. 30, 2016	Dec. 31, 2015
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	$ 1,001,484	$ 985,399
Balance, end of period: Individually evaluated for impairment	44,765	34,640
Balance, end of period: Collectively evaluated for impairment	956,719	950,759
Commercial
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	342,632	329,534
Balance, end of period: Individually evaluated for impairment	19,773	15,248
Balance, end of period: Collectively evaluated for impairment	322,859	314,286
Real estate construction one-to-four family
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	37,002	44,488
Balance, end of period: Individually evaluated for impairment	3,972	0
Balance, end of period: Collectively evaluated for impairment	33,030	44,488
Real estate construction other
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	72,091	74,931
Balance, end of period: Individually evaluated for impairment	1,912	0
Balance, end of period: Collectively evaluated for impairment	70,179	74,931
Real estate term owner occupied
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	166,941	128,763
Balance, end of period: Individually evaluated for impairment	17,019	17,229
Balance, end of period: Collectively evaluated for impairment	149,922	111,534
Real estate term non-owner occupied
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	288,975	314,069
Balance, end of period: Individually evaluated for impairment	616	825
Balance, end of period: Collectively evaluated for impairment	288,359	313,244
Real estate term other
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	41,864	38,029
Balance, end of period: Individually evaluated for impairment	644	790
Balance, end of period: Collectively evaluated for impairment	41,220	37,239
Consumer secured by 1st deeds of trust
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	25,957	26,673
Balance, end of period: Individually evaluated for impairment	829	548
Balance, end of period: Collectively evaluated for impairment	25,128	26,125
Consumer other
Financing Receivable, Allowance for Credit Losses [Line Items]
Total financing receivables	26,022	28,912
Balance, end of period: Individually evaluated for impairment	0	0
Balance, end of period: Collectively evaluated for impairment	$ 26,022	$ 28,912