RESIDENTIAL MORTGAGE LOANS - Residential Mortgage Loans Outstanding by Loan Type, Excluding REO (Details) $ in Thousands	3 Months Ended
	Mar. 31, 2025 USD ($) loan	Dec. 31, 2024 USD ($)
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 35,000
Weighted Average Life (Years)	3 years 8 months 12 days
Consolidated Investments
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 2,866,929
Carrying Value	$ 2,703,112	$ 2,791,027
Loan Count | loan	7,503
Weighted Average Yield	5.80%
Weighted Average Life (Years)	25 years 7 months 6 days
Residential mortgage loans, HFI, at fair value
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 384,304
Carrying Value	$ 354,003	361,890
Loan Count | loan	7,220
Weighted Average Yield	8.00%
Weighted Average Life (Years)	4 years 8 months 12 days
Total Residential Mortgage Loans, HFS
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 72,641
Carrying Value	$ 64,248	66,670
Loan Count | loan	1,848
Weighted Average Yield	7.60%
Weighted Average Life (Years)	4 years 2 months 12 days
Acquired performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 54,503
Carrying Value	$ 49,558	51,011
Loan Count | loan	1,629
Weighted Average Yield	7.00%
Weighted Average Life (Years)	4 years 3 months 18 days
Acquired performing loans | Ginnie Mae
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
UPB	$ 226,300
Acquired non-performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	18,138
Carrying Value	$ 14,690	15,659
Loan Count | loan	219
Weighted Average Yield	9.40%
Weighted Average Life (Years)	4 years
Acquired non-performing loans | Ginnie Mae
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
UPB	$ 273,800
Total Residential Mortgage Loans, HFS, at Fair Value
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	3,047,797
Carrying Value	$ 3,092,102	4,307,571
Loan Count | loan	11,440
Weighted Average Yield	6.50%
Weighted Average Life (Years)	27 years 9 months 18 days
Acquired performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 339,705
Carrying Value	$ 328,564	408,421
Loan Count | loan	1,582
Weighted Average Yield	5.80%
Weighted Average Life (Years)	22 years 2 months 12 days
Acquired non-performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 285,134
Carrying Value	$ 263,040	270,879
Loan Count | loan	1,302
Weighted Average Yield	5.00%
Weighted Average Life (Years)	27 years 6 months
Originated loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 2,422,958
Carrying Value	$ 2,500,498	$ 3,628,271
Loan Count | loan	8,556
Weighted Average Yield	6.80%
Weighted Average Life (Years)	28 years 7 months 6 days