Fair Value of Financial Instruments - Schedule of Changes in Level 3 Assets and Liabilities Measured at Fair Value on Recurring Basis (Details) $ in Thousands	12 Months Ended
	Dec. 31, 2024 USD ($)
ABS Issued
Liabilities
Beginning balance	$ 9,151,263
Acquisitions	5,596,807
Sales	(1,544)
Principal paydowns	(1,878,771)
Gains (losses) in net income (loss), net	11,775
Other settlements, net	0
Ending balance	12,879,530
Change in unrealized gains or (losses) for the period included in earnings for liabilities held at the end of the reporting period	288,862
Non-controlling interests
Liabilities
Beginning balance	59,752
Acquisitions	11,882
Sales	0
Principal paydowns	(315)
Gains (losses) in net income (loss), net	27,738
Other settlements, net	453
Ending balance	99,510
Change in unrealized gains or (losses) for the period included in earnings for liabilities held at the end of the reporting period	(27,738)
Residential Consumer Loans
Assets
Beginning balance	7,050,637
Acquisitions	7,120,201
Originations	0
Sales	(1,667,513)
Principal paydowns	(1,458,762)
Gains (losses) in net income (loss), net	36,147
Unrealized gains in OCI, net	0
Other settlements, net	(2,887)
Ending balance	11,077,823
Change in unrealized gains or (losses) for the period included in earnings for assets held at the end of the reporting period	(58,330)
Residential Investor Loans
Assets
Beginning balance	5,220,297
Acquisitions	19,746
Originations	1,681,723
Sales	(1,236,441)
Principal paydowns	(1,412,926)
Gains (losses) in net income (loss), net	37,035
Unrealized gains in OCI, net	0
Other settlements, net	(20,897)
Ending balance	4,587,090
Change in unrealized gains or (losses) for the period included in earnings for assets held at the end of the reporting period	1,697
Consolidated Agency Multifamily Loans
Assets
Beginning balance	425,285
Acquisitions	0
Originations	0
Sales	0
Principal paydowns	(8,638)
Gains (losses) in net income (loss), net	7,950
Unrealized gains in OCI, net	0
Other settlements, net	0
Ending balance	424,597
Change in unrealized gains or (losses) for the period included in earnings for assets held at the end of the reporting period	7,682
Real Estate Trading Securities
Assets
Beginning balance	40,424
Acquisitions	117,502
Originations	0
Sales	(2,833)
Principal paydowns	(673)
Gains (losses) in net income (loss), net	39,329
Unrealized gains in OCI, net	0
Other settlements, net	0
Ending balance	193,749
Change in unrealized gains or (losses) for the period included in earnings for assets held at the end of the reporting period	39,014
Real Estate AFS Securities
Assets
Beginning balance	87,373
Acquisitions	117,280
Originations	0
Sales	0
Principal paydowns	(7,835)
Gains (losses) in net income (loss), net	2,360
Unrealized gains in OCI, net	12,296
Other settlements, net	0
Ending balance	211,474
Change in unrealized gains or (losses) for the period included in earnings for assets held at the end of the reporting period	12,345
HEI
Assets
Beginning balance	550,436
Acquisitions	0
Sales	0
Principal paydowns	(49,553)
Gains (losses) in net income (loss), net	86,687
Unrealized gains in OCI, net	0
Other settlements, net	172
Ending balance	589,785
Change in unrealized gains or (losses) for the period included in earnings for assets held at the end of the reporting period	75,525
Servicer Advance Investments
Assets
Beginning balance	225,345
Acquisitions	0
Originations	0
Sales	0
Principal paydowns	(357)
Gains (losses) in net income (loss), net	8,832
Unrealized gains in OCI, net	0
Other settlements, net	0
Ending balance	233,820
Change in unrealized gains or (losses) for the period included in earnings for assets held at the end of the reporting period	8,832
Excess MSRs
Assets
Beginning balance	37,367
Acquisitions	0
Originations	0
Sales	0
Principal paydowns	0
Gains (losses) in net income (loss), net	(5,093)
Unrealized gains in OCI, net	0
Other settlements, net	0
Ending balance	32,274
Change in unrealized gains or (losses) for the period included in earnings for assets held at the end of the reporting period	(5,093)
MSRs/Strategic Investments/Other
Assets
Beginning balance	28,070
Acquisitions	2,061
Originations	0
Sales	0
Principal paydowns	(141)
Gains (losses) in net income (loss), net	5,159
Unrealized gains in OCI, net	0
Other settlements, net	(100)
Ending balance	35,049
Change in unrealized gains or (losses) for the period included in earnings for assets held at the end of the reporting period	6,693
Derivatives
Assets
Beginning balance	8,104
Acquisitions	0
Sales	0
Principal paydowns	0
Gains (losses) in net income (loss), net	9,231
Other settlements, net	(12,012)
Ending balance	5,323
Liabilities
Change in unrealized gains or (losses) for the period included in earnings for liabilities held at the end of the reporting period	$ 5,323