Taxes - Components of Net Deferred Tax Assets (Details) - USD ($) $ in Thousands	Dec. 31, 2020	Dec. 31, 2019
Deferred Tax Assets
Net operating loss carryforward – state	$ 103,334	$ 98,554
Net capital loss carryforward – state	23,487	0
Net operating loss carryforward – federal	82	82
Real estate assets	2,948	676
Allowances and accruals	3,324	1,930
Goodwill and intangible assets	23,231	2,739
Other	1,914	1,749
Tax effect of unrealized (gains) / losses - OCI	124	0
Total Deferred Tax Assets	158,444	105,730
Deferred Tax Liabilities
Mortgage Servicing Rights	(2,458)	(13,783)
Interest rate agreements	(3,867)	(42)
Total Deferred Tax Liabilities	(6,325)	(13,825)
Valuation allowance	(151,248)	(97,057)
Total Deferred Tax Asset (Liability), net of Valuation Allowance	$ 871
Total Deferred Tax Asset (Liability), net of Valuation Allowance		$ (5,152)