Income Taxes - Summary of Net Deferred Tax Assets (Liabilities) (Details) - USD ($) $ in Thousands	Dec. 31, 2015	Dec. 31, 2014
Allowance for loan losses	$ 7,759	$ 6,926
Other real estate owned	1,737	1,562
Accrued stock compensation	1,235	721
Federal tax loss carryforward	33,507	39,974
State tax loss carryforward	6,767	7,580
Alternative minimum tax carryforward	3,355	2,136
Net unrealized securities losses	3,906	3,035
Deferred compensation	1,829	1,643
Accrued interest and fee income	2,404	3,270
Other	7,194	7,428
Gross deferred tax assets	69,693	74,275
Less: Valuation allowance	0	0
Deferred tax assets net of valuation allowance	69,693	74,275
Depreciation	(1,211)	(1,334)
Deposit base intangible	(3,452)	(2,976)
Other	(4,756)	(3,165)
Gross deferred tax liabilities	(9,419)	(7,475)
Net deferred tax assets	$ 60,274	$ 66,800