Income Taxes - Schedule of Net Deferred Tax liability (Details) - USD ($) $ in Thousands	Mar. 31, 2017	Dec. 31, 2016
Deferred tax assets:
Allowance for loan losses	$ 8,967	$ 8,516
Amortization of core deposit intangible	1,031	996
Compensation related	4,491	7,552
Unrealized loss on securities	2,107	2,462
Net operating loss carryforward	3,212
Other	2,349	2,430
Subtotal	22,157	21,956
Deferred tax liabilities:
FHLB stock dividends	(827)	(827)
Depreciation	(6,476)	(6,548)
Mortgage servicing rights	(18,637)	(12,558)
Other	(6,175)	(6,203)
Subtotal	(32,115)	(26,136)
Net deferred tax liability	$ (9,958)	$ (4,180)