Income Taxes - Significant Components of The Company's Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Mar. 31, 2019	Dec. 31, 2018
Deferred tax assets
Allowance for loan losses	$ 14,292	$ 14,097
Loans	16,864	18,655
Deferred compensation	8,554	10,001
Securities	2,614	6,180
Impairment of assets	1,748	1,280
Federal and State net operating loss carryforwards	16,938	19,065
Other	16,624	3,610
Total deferred tax assets	77,634	72,888
Deferred tax liabilities
Investment in partnerships	1,469	1,572
Fixed assets	3,865	3,865
Mortgage servicing rights	12,542	12,350
Junior subordinated debt	1,652	1,607
Other	15,903	1,792
Total deferred tax liabilities	35,431	21,186
Net deferred tax assets	$ 42,203	$ 51,702