FAIR VALUE MEASUREMENTS (AS RESTATED) - Financial Assets Measured at Fair Value on a Recurring Basis using Level 3 Inputs (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2023	Dec. 31, 2022
Purchases, sales and repayments
Fair Value, Asset, Recurring Basis, Unobservable Input Reconciliation, Asset, Gain (Loss), Statement of Other Comprehensive Income or Comprehensive Income [Extensible Enumeration]	Unrealized gain (loss) on available-for-sale securities, net
Fair Value, Asset (Liability), Recurring Basis, Unobservable Input Reconciliation, Gain (Loss), Statement of Income or Comprehensive Income [Extensible Enumeration]	Other income (loss)
Fair Value, Asset, Recurring Basis, Unobservable Input Reconciliation, Gain (Loss), Statement of Income or Comprehensive Income [Extensible Enumeration]	Realized and unrealized gains (losses), net
Excess MSRs in Equity Method Investees
Purchases, sales and repayments
Ownership percentage	50.00%	50.00%
Non-Agency
Gain (loss) included in net income
Gain (loss) on settlement of investments, net	$ 0	$ (1,600)
Recurring Basis
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance, beginning	13,469,365	13,242,784
Transfers
Transfers from Level 3	(41,430)	(1,280,709)
Transfers to Level 3	22,565	313,559
Acquisitions	216,229
Gain (loss) included in net income
Credit losses on securities	2,951	(710)
Servicing revenue, net	(565,684)	817,691
Excess MSRs	(12,712)	(2,962)
Excess MSRs, equity method investees		1,526
Real estate securities		(17,716)
Servicer advance investments	8,049	(9,950)
Consumer loans	(26,201)	(36,740)
Residential mortgage loans	14,911	(124,359)
Gain (loss) on settlement of investments, net	615	(45,320)
Other income (loss), net	69,878	(202,536)
Gains (losses) included in OCI	13,118	(45,709)
Interest income	96,772	111,047
Purchases, sales and repayments
Purchases, net	2,772,795	3,176,436
Proceeds from sales	(933,321)	(2,427,352)
Proceeds from repayments	(3,674,600)	(3,214,062)
Originations and other	2,898,351	3,214,447
Balance, ending	14,331,651	13,469,365
Recurring Basis | Excess MSRs
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance, beginning	321,803	344,947
Transfers
Transfers from Level 3	0	0
Transfers to Level 3	0	0
Acquisitions	0
Gain (loss) included in net income
Credit losses on securities	0	0
Servicing revenue, net	0	0
Excess MSRs	(12,712)	(2,962)
Excess MSRs, equity method investees		1,526
Real estate securities		0
Servicer advance investments	0	0
Consumer loans	0	0
Residential mortgage loans	0	0
Gain (loss) on settlement of investments, net	615	107
Other income (loss), net	(348)	(65)
Gains (losses) included in OCI	0	0
Interest income	18,310	38,035
Purchases, sales and repayments
Purchases, net	0	0
Proceeds from sales	(4,212)	(997)
Proceeds from repayments	(52,306)	(58,788)
Originations and other	0	0
Balance, ending	271,150	321,803
Recurring Basis | MSRs And MSR Financing Receivables
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance, beginning	8,889,403	6,858,803
Transfers
Transfers from Level 3	0	0
Transfers to Level 3	0	0
Acquisitions	0
Gain (loss) included in net income
Credit losses on securities	0	0
Servicing revenue, net	(565,684)	817,691
Excess MSRs	0	0
Excess MSRs, equity method investees		0
Real estate securities		0
Servicer advance investments	0	0
Consumer loans	0	0
Residential mortgage loans	0	0
Gain (loss) on settlement of investments, net	0	0
Other income (loss), net	0	0
Gains (losses) included in OCI	0	0
Interest income	0	0
Purchases, sales and repayments
Purchases, net	0	(967)
Proceeds from sales	(704,436)	(8,866)
Proceeds from repayments	0	0
Originations and other	786,655	1,222,742
Balance, ending	8,405,938	8,889,403
Recurring Basis | Servicer Advances
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance, beginning	398,820	421,807
Transfers
Transfers from Level 3	0	0
Transfers to Level 3	0	0
Acquisitions	0
Gain (loss) included in net income
Credit losses on securities	0	0
Servicing revenue, net	0	0
Excess MSRs	0	0
Excess MSRs, equity method investees		0
Real estate securities		0
Servicer advance investments	8,049	(9,950)
Consumer loans	0	0
Residential mortgage loans	0	0
Gain (loss) on settlement of investments, net	0	0
Other income (loss), net	0	0
Gains (losses) included in OCI	0	0
Interest income	22,180	42,005
Purchases, sales and repayments
Purchases, net	852,015	988,847
Proceeds from sales	0	0
Proceeds from repayments	(904,183)	(1,043,889)
Originations and other	0	0
Balance, ending	376,881	398,820
Recurring Basis | Non-Agency
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance, beginning	614,472	768,879
Transfers
Transfers from Level 3	0	0
Transfers to Level 3	0	0
Acquisitions	216,229
Gain (loss) included in net income
Credit losses on securities	2,951	(710)
Servicing revenue, net	0	0
Excess MSRs	0	0
Excess MSRs, equity method investees		0
Real estate securities		(17,716)
Servicer advance investments	0	0
Consumer loans	0	0
Residential mortgage loans	0	0
Gain (loss) on settlement of investments, net		(1,560)
Other income (loss), net	10,650	0
Gains (losses) included in OCI	13,118	(45,709)
Interest income	12,929	4,180
Purchases, sales and repayments
Purchases, net	17,833	50,392
Proceeds from sales	0	(11,958)
Proceeds from repayments	(84,153)	(131,326)
Originations and other	0	0
Balance, ending	804,029	614,472
Recurring Basis | Derivatives
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance, beginning	8,786	111,778
Transfers
Transfers from Level 3	0	0
Transfers to Level 3	0	0
Acquisitions	0
Gain (loss) included in net income
Credit losses on securities	0	0
Servicing revenue, net	0	0
Excess MSRs	0	0
Excess MSRs, equity method investees		0
Real estate securities		0
Servicer advance investments	0	0
Consumer loans	0	0
Residential mortgage loans	0	0
Gain (loss) on settlement of investments, net	0	0
Other income (loss), net	15,018	(102,992)
Gains (losses) included in OCI	0	0
Interest income	0	0
Purchases, sales and repayments
Purchases, net	0	0
Proceeds from sales	0	0
Proceeds from repayments	0	0
Originations and other	0	0
Balance, ending	23,804	8,786
Recurring Basis | Residential Mortgage Loans
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance, beginning	713,896	2,423,337
Transfers
Transfers from Level 3	(41,430)	(1,279,709)
Transfers to Level 3	22,565	313,559
Acquisitions	0
Gain (loss) included in net income
Credit losses on securities	0	0
Servicing revenue, net	0	0
Excess MSRs	0	0
Excess MSRs, equity method investees		0
Real estate securities		0
Servicer advance investments	0	0
Consumer loans	0	0
Residential mortgage loans	14,911	(124,359)
Gain (loss) on settlement of investments, net	0	0
Other income (loss), net	44,694	(35,020)
Gains (losses) included in OCI	0	0
Interest income	0	0
Purchases, sales and repayments
Purchases, net	38,992	2,099,549
Proceeds from sales	(252,183)	(2,405,531)
Proceeds from repayments	(91,249)	(272,224)
Originations and other	63,185	(5,706)
Balance, ending	513,381	713,896
Recurring Basis | Consumer Loans
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance, beginning	363,756	507,291
Transfers
Transfers from Level 3	0	0
Transfers to Level 3	0	0
Acquisitions	0
Gain (loss) included in net income
Credit losses on securities	0	0
Servicing revenue, net	0	0
Excess MSRs	0	0
Excess MSRs, equity method investees		0
Real estate securities		0
Servicer advance investments	0	0
Consumer loans	(26,201)	(36,740)
Residential mortgage loans	0	0
Gain (loss) on settlement of investments, net	0	0
Other income (loss), net	0	0
Gains (losses) included in OCI	0	0
Interest income	37,717	13,891
Purchases, sales and repayments
Purchases, net	1,317,347	29,615
Proceeds from sales	27,510	0
Proceeds from repayments	(446,124)	(150,301)
Originations and other	0	0
Balance, ending	1,274,005	363,756
Recurring Basis | Notes and Loans Receivable
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance, beginning	94,401	290,180
Transfers
Transfers from Level 3	0	(1,000)
Transfers to Level 3	0	0
Acquisitions	0
Gain (loss) included in net income
Credit losses on securities	0	0
Servicing revenue, net	0	0
Excess MSRs	0	0
Excess MSRs, equity method investees		0
Real estate securities		0
Servicer advance investments	0	0
Consumer loans	0	0
Residential mortgage loans	0	0
Gain (loss) on settlement of investments, net	0	0
Other income (loss), net	231	(64,459)
Gains (losses) included in OCI	0	0
Interest income	5,636	12,936
Purchases, sales and repayments
Purchases, net	399,977	9,000
Proceeds from sales	0	0
Proceeds from repayments	(70,695)	(152,256)
Originations and other	0	0
Balance, ending	429,550	94,401
Recurring Basis | Mortgage Loans Receivable
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance, beginning	2,064,028	1,515,762
Transfers
Transfers from Level 3	0	0
Transfers to Level 3	0	0
Acquisitions	0
Gain (loss) included in net income
Credit losses on securities	0	0
Servicing revenue, net	0	0
Excess MSRs	0	0
Excess MSRs, equity method investees		0
Real estate securities		0
Servicer advance investments	0	0
Consumer loans	0	0
Residential mortgage loans	0	0
Gain (loss) on settlement of investments, net	0	(43,867)
Other income (loss), net	(367)	0
Gains (losses) included in OCI	0	0
Interest income	0	0
Purchases, sales and repayments
Purchases, net	146,631	0
Proceeds from sales	0	0
Proceeds from repayments	(2,025,890)	(1,405,278)
Originations and other	2,048,511	1,997,411
Balance, ending	$ 2,232,913	$ 2,064,028