CASH, CASH EQUIVALENTS AND RESTRICTED CASH - Restricted Cash (Details) - USD ($) $ in Thousands	Dec. 31, 2023	Dec. 31, 2022
Restricted Cash and Cash Equivalents Items [Line Items]
Restricted cash	$ 385,620	$ 281,126
Operating Segments | Investment Portfolio
Restricted Cash and Cash Equivalents Items [Line Items]
Restricted cash	144,169	94,508
Operating Segments | Origination and servicing
Restricted Cash and Cash Equivalents Items [Line Items]
Restricted cash	195,490	161,249
Operating Segments | Mortgage Loans Receivable
Restricted Cash and Cash Equivalents Items [Line Items]
Restricted cash	37,805	25,369
Operating Segments | Asset management
Restricted Cash and Cash Equivalents Items [Line Items]
Restricted cash	$ 8,156	$ 0