Mortgage Servicing - Schedule of Composition of Primary Servicing and Subservicing Portfolios by Type of Property Serviced as Measured by UPB (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Servicing Assets at Fair Value [Line Items]
Servicing	$ 76,657,932	$ 72,378,693	$ 75,469,327
Subservicing	17,120,905	53,104,560	2,063,669
NRZ	118,587,594	130,517,237	101,819,557
Assets Serviced	212,366,431	$ 256,000,490	$ 179,352,553
Third-party Consents Received and MSR Transferred
Servicing Assets at Fair Value [Line Items]
NRZ	57,700,000
Unrelated Party | NRZ
Servicing Assets at Fair Value [Line Items]
Unpaid principal balance on servicing assets acquired	$ 6,600,000