Income Taxes - Schedule of Net Deferred Tax liability (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Dec. 31, 2016
Deferred tax assets:
Allowance for loan losses	$ 9,103	$ 8,516
Amortization of core deposit intangible	962	996
Compensation related	5,648	7,552
Unrealized loss on securities	1,066	2,462
Other	2,279	2,430
Subtotal	19,058	21,956
Deferred tax liabilities:
FHLB stock dividends	(827)	(827)
Depreciation	(6,449)	(6,548)
Mortgage servicing rights	(18,979)	(12,558)
Other	(6,331)	(6,203)
Subtotal	(32,586)	(26,136)
Net deferred tax liability	$ (13,528)	$ (4,180)