RESIDENTIAL MORTGAGE LOANS (AS RESTATED) - Residential Mortgage Loans Outstanding by Loan Type, Excluding REO (Details) $ in Thousands	12 Months Ended
	Dec. 31, 2023 USD ($) loan	Dec. 31, 2022 USD ($)
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Weighted Average Life (Years)	4 years
Consolidated Investments
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 3,252,463
Loan Count | loan	9,012
Weighted Average Yield	5.30%
Weighted Average Life (Years)	26 years 9 months 18 days
Mortgage Loans On Real Estate, Carrying Amount Of Mortgages, Including Interest	$ 3,038,587	$ 2,431,867
Residential mortgage loans, held-for-investment, at fair value
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	448,060
Carrying Value	$ 379,044	452,519
Loan Count | loan	8,328
Weighted Average Yield	8.10%
Weighted Average Life (Years)	5 years 6 months
Total residential mortgage loans, held-for-sale, at lower of cost or market
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 94,336
Carrying Value	$ 78,877	101,027
Loan Count | loan	2,213
Weighted Average Yield	8.20%
Weighted Average Life (Years)	5 years 9 months 18 days
Acquired performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 67,955
Carrying Value	$ 57,038	72,425
Loan Count | loan	1,887
Weighted Average Yield	8.10%
Weighted Average Life (Years)	5 years 10 months 24 days
Acquired performing loans | Ginnie Mae
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
UPB	$ 224,500
Acquired non-performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	26,381
Carrying Value	$ 21,839	28,602
Loan Count | loan	326
Weighted Average Yield	8.50%
Weighted Average Life (Years)	5 years 7 months 6 days
Acquired non-performing loans | Ginnie Mae
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
UPB	$ 198,200
Total residential mortgage loans, held-for-sale, at fair value
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	2,460,924
Carrying Value	$ 2,461,865	3,297,271
Loan Count | loan	8,957
Weighted Average Yield	6.60%
Weighted Average Life (Years)	26 years 9 months 18 days
Acquired performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 423,644
Carrying Value	$ 400,603	890,131
Loan Count | loan	1,972
Weighted Average Yield	5.70%
Weighted Average Life (Years)	16 years 4 months 24 days
Acquired non-performing loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 220,962
Carrying Value	$ 204,950	340,342
Loan Count | loan	1,135
Weighted Average Yield	4.60%
Weighted Average Life (Years)	25 years 2 months 12 days
Originated loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 1,816,318
Carrying Value	$ 1,856,312	2,066,798
Loan Count | loan	5,850
Weighted Average Yield	7.10%
Weighted Average Life (Years)	29 years 4 months 24 days
Total residential mortgage loans, held-for-sale, at fair value/lower of cost or market
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Outstanding Face Amount	$ 2,555,260
Carrying Value	$ 2,540,742	$ 3,398,298
Residential Mortgage Loans Held-For-Sale
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Loan Count | loan	11,170