Business Acquisitions - Schedule of Purchase Price Allocation of Assets Acquired and Liabilities Assumed (Details) - USD ($) $ in Thousands		12 Months Ended
	Oct. 04, 2018	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Business Acquisition [Line Items]
Total consideration paid to seller		$ 0	$ (358,396)	$ 0
Bargain purchase gain		(381)	$ 64,036	$ 0
PHH Corporation
Business Acquisition [Line Items]
Cash	$ 423,088	423,088
Restricted cash	38,813	38,813
MSRs	518,127	518,127
Advances	96,163	96,067
Advances adjustment		(96)
Loans held for sale	42,324	42,682
Loans held for sale adjustment		358
Receivables	46,838	46,838
Premises and equipment	15,203	15,203
Real estate owned	3,289	3,289
Other assets	6,293	6,293
Assets related to discontinued operations	2,017	2,017
Financing liabilities (MSRs pledged, at fair value)	(481,020)	(481,020)
Other secured borrowings	(27,594)	(27,594)
Senior notes (Senior unsecured notes)	(120,624)	(120,624)
Accrued legal fees and settlements	(9,960)	(9,960)
Other accrued expenses	(36,889)	(36,889)
Loan repurchase and indemnification liability	(27,736)	(27,736)
Unfunded pension liability	(9,815)	(9,815)
Other liabilities	(34,131)	(34,774)
Other liabilities adjustment		(643)
Liabilities related to discontinued operations	(21,954)	(21,954)
Total identifiable net assets	422,432	422,051
Total identifiable net assets adjustment		(381)
Total consideration paid to seller	(358,396)	(358,396)
Bargain purchase gain	$ 64,036	63,655
Bargain purchase gain adjustment		$ (381)