Income Taxes - Significant Components of The Company's Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Sep. 30, 2019	Dec. 31, 2018
Deferred tax assets
Allowance for loan losses	$ 15,276	$ 14,097
Loans	14,260	18,655
Deferred compensation	10,941	10,001
Securities	0	6,180
Impairment of assets	1,150	1,280
Federal and State net operating loss carryforwards	12,357	19,065
Leases	23,485	0
Other	6,074	9,800
Total deferred tax assets	83,543	79,078
Deferred tax liabilities
Securities	507	0
Investment in partnerships	1,265	1,572
Fixed assets	3,864	3,865
Mortgage servicing rights	13,179	12,350
Junior subordinated debt	2,372	1,607
Intangibles	5,255	6,190
Right of use assets	22,498	0
Other	1,369	1,792
Total deferred tax liabilities	50,309	27,376
Net deferred tax assets	$ 33,234	$ 51,702