Income Taxes - Schedule of Deferred Income Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2018	Feb. 09, 2018	Dec. 31, 2017	Dec. 31, 2016
Deferred tax assets
Goodwill	$ 65,426		$ 66,699
Reverse loans	60,776		48,814
Servicer and protective advances	40,497		37,793
Curtailment liability	25,228		33,724
Net operating losses	16,644		113,315
Disallowed interest expense	10,997		0
Intangible assets	8,677		20,978
Accrued expenses	6,310		8,396
Net investment in residential loans	4,772		0
Accrued legal contingencies and settlements	3,388		6,727
Other	31,397		50,638
Total deferred tax assets	274,112		387,084
Valuation allowance	(221,913)	$ (178,303)	(328,661)	$ (346,199)
Total deferred tax assets, net of valuation allowance	52,199		58,423
Deferred tax liabilities
Servicing rights	(53,617)		(52,587)
Net investment in residential loans	0		(3,972)
Other	(454)		(1,312)
Total deferred tax liabilities	(54,071)		(57,871)
Deferred tax liabilities, net	$ (1,872)
Deferred tax assets, net			$ 552