Income Taxes - Schedule of Net Deferred Tax liability (Details) - USD ($) $ in Thousands	Sep. 30, 2017	Dec. 31, 2016
Deferred tax assets:
Allowance for loan losses	$ 9,196	$ 8,516
Amortization of core deposit intangible	1,023	996
Compensation related	7,306	7,552
Unrealized loss on securities	884	2,462
Other	6,248	2,430
Subtotal	24,657	21,956
Deferred tax liabilities:
FHLB stock dividends	(827)	(827)
Depreciation	(6,417)	(6,548)
Mortgage servicing rights	(24,689)	(12,558)
Other	(7,106)	(6,203)
Subtotal	(39,039)	(26,136)
Net deferred tax liability	$ (14,382)	$ (4,180)