Consolidated Securitization Vehicles and Other Variable Interest Entities - Income, OTTI and Expense Amounts Related to Consolidated VIEs (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2023	Jun. 30, 2022	Jun. 30, 2023	Jun. 30, 2022
Variable Interest Entity [Line Items]
Net interest income	$ 65,678	$ 116,890	$ 135,313	$ 254,593
(Increase) decrease in provision for credit losses			(5,824)	(4,737)
Servicing and asset manager fees	8,408	9,315	16,825	18,607
Variable Interest Entities, Primary Beneficiary
Variable Interest Entity [Line Items]
(Increase) decrease in provision for credit losses	(531)	(3,120)	(1,959)	(3,143)
Servicing and asset manager fees	14,204	6,692	7,336	13,555
Non Agency Residential Mortgage Backed Securities And Securitized Loans | Variable Interest Entities, Primary Beneficiary
Variable Interest Entity [Line Items]
Interest income, Assets of consolidated VIEs	149,674	140,209	289,576	271,275
Interest expense, Non-recourse liabilities of VIEs	72,624	50,193	132,776	92,684
Net interest income	$ 77,051	$ 90,016	$ 156,800	$ 178,591