RESIDENTIAL MORTGAGE LOANS - Schedule of Residential Mortgage Loans Outstanding by Loan Type (Details) $ in Thousands	3 Months Ended
	Mar. 31, 2024 USD ($) loan	Dec. 31, 2023 USD ($)
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Weighted Average Life (Years)	1 year 2 months 12 days
Total residential mortgage loans, HFI, at fair value
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 434,474
Carrying Value	$ 365,398	$ 379,044
Loan Count | loan	8,070
Weighted Average Yield	8.10%
Weighted Average Life (Years)	5 years 2 months 12 days
Total residential mortgage loans, HFS, at lower of cost or market
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 89,460
Carrying Value	$ 74,415	78,877
Loan Count | loan	2,143
Weighted Average Yield	8.10%
Weighted Average Life (Years)	5 years 6 months
Acquired performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 64,851
Carrying Value	$ 54,056	57,038
Loan Count | loan	1,841
Weighted Average Yield	8.00%
Weighted Average Life (Years)	5 years 3 months 18 days
Acquired performing loans | Ginnie Mae
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Unpaid Principal Balance	$ 228,600
Acquired non-performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	24,609
Carrying Value	$ 20,359	21,839
Loan Count | loan	302
Weighted Average Yield	8.50%
Weighted Average Life (Years)	6 years
Acquired non-performing loans | Ginnie Mae
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Unpaid Principal Balance	$ 222,700
Total residential mortgage loans, HFS, at fair value
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	3,701,355
Carrying Value	$ 3,691,700	2,461,865
Loan Count | loan	13,509
Weighted Average Yield	6.50%
Weighted Average Life (Years)	27 years
Acquired performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 542,335
Carrying Value	$ 490,552	400,603
Loan Count | loan	2,979
Weighted Average Yield	5.70%
Weighted Average Life (Years)	15 years 9 months 18 days
Acquired non-performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 294,077
Carrying Value	$ 271,316	204,950
Loan Count | loan	1,501
Weighted Average Yield	4.80%
Weighted Average Life (Years)	23 years 1 month 6 days
Originated loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 2,864,943
Carrying Value	$ 2,929,832	1,856,312
Loan Count | loan	9,029
Weighted Average Yield	6.80%
Weighted Average Life (Years)	29 years 6 months
Total residential mortgage loans, HFS, at fair value and lower of cost or fair value
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 3,790,815
Carrying Value	$ 3,766,115	$ 2,540,742