Income Taxes - Significant Components of The Company's Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Jun. 30, 2019	Dec. 31, 2018
Deferred tax assets
Allowance for loan losses	$ 14,146	$ 14,097
Loans	14,977	18,655
Deferred compensation	9,301	10,001
Securities	(103)	6,180
Impairment of assets	2,336	1,280
Federal and State net operating loss carryforwards	14,899	19,065
Other	21,358	3,610
Total deferred tax assets	76,914	72,888
Deferred tax liabilities
Investment in partnerships	1,367	1,572
Fixed assets	3,864	3,865
Mortgage servicing rights	12,492	12,350
Junior subordinated debt	1,697	1,607
Other	20,645	1,792
Total deferred tax liabilities	40,065	21,186
Net deferred tax assets	$ 36,849	$ 51,702