Contingencies - Schedule of Changes in Liability for Representation and Warrant Obligations, Compensatory Fees for Foreclosures that may Ultimately Exceed Investor Timelines and Related Indemnification Obligations (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Indemnification Obligations Liability [Roll Forward]
Beginning balance	$ 49,267	$ 19,229	$ 24,285
Provision (reversal) for representation and warranty obligations	(11,701)	4,649	(1,371)
New production reserves	304	7,437	702
Obligation assumed in connection with the acquisition of PHH	0	27,736	0
Charge-offs and other	12,968	(9,784)	(4,387)
Ending balance	$ 50,838	$ 49,267	$ 19,229