Secured Financing Agreements - Schedule of Secured Financing Agreements (Details) - USD ($) $ in Thousands	6 Months Ended	12 Months Ended
	Jun. 30, 2023	Dec. 31, 2022
Assets Sold under Agreements to Repurchase [Line Items]
Secured financing agreements outstanding principal secured by:	$ 2,686,522	$ 3,434,765
Debt issuance costs, net	2,000	1,000
Repurchase Agreements
Assets Sold under Agreements to Repurchase [Line Items]
Secured financing agreements outstanding principal secured by:	2,707,634	3,443,431
Average balance of Secured financing agreements secured by:	3,051,451	3,208,136
Repurchase Agreements | Asset Pledged as Collateral
Assets Sold under Agreements to Repurchase [Line Items]
MBS pledged as collateral at fair value on Secured financing agreements	3,898,631	4,699,722
Repurchase Agreements | Agency RMBS
Assets Sold under Agreements to Repurchase [Line Items]
Secured financing agreements outstanding principal secured by:	0	3,946
Average balance of Secured financing agreements secured by:	$ 2,881	$ 11,714
Average borrowing rate of Secured financing agreements secured by:	0.00%	4.70%
Average remaining maturity of Secured financing agreements secured by:		17 days
Average original maturity of Secured financing agreements secured by:		60 days
Repurchase Agreements | Agency RMBS | Asset Pledged as Collateral
Assets Sold under Agreements to Repurchase [Line Items]
MBS pledged as collateral at fair value on Secured financing agreements	$ 0	$ 6,662
Repurchase Agreements | Agency MBS - Project Loans
Assets Sold under Agreements to Repurchase [Line Items]
Secured financing agreements outstanding principal secured by:	100,899	355,934
Average balance of Secured financing agreements secured by:	$ 190,448	$ 376,551
Average borrowing rate of Secured financing agreements secured by:	5.23%	4.49%
Average remaining maturity of Secured financing agreements secured by:	26 days	25 days
Average original maturity of Secured financing agreements secured by:	121 days	42 days
Repurchase Agreements | Agency MBS - Project Loans | Asset Pledged as Collateral
Assets Sold under Agreements to Repurchase [Line Items]
MBS pledged as collateral at fair value on Secured financing agreements	$ 103,135	$ 382,547
Repurchase Agreements | Non-agency MBS and Loans held for investment
Assets Sold under Agreements to Repurchase [Line Items]
Secured financing agreements outstanding principal secured by:	2,606,735	3,083,551
Average balance of Secured financing agreements secured by:	$ 2,858,122	$ 2,819,871
Average borrowing rate of Secured financing agreements secured by:	7.34%	6.86%
Average remaining maturity of Secured financing agreements secured by:	479 days	474 days
Average original maturity of Secured financing agreements secured by:	585 days	499 days
Repurchase Agreements | Non-agency MBS and Loans held for investment | Asset Pledged as Collateral
Assets Sold under Agreements to Repurchase [Line Items]
MBS pledged as collateral at fair value on Secured financing agreements	$ 3,795,496	$ 4,310,513