Residential Whole Loans and Bridge Loans - Summary of the Assets and Liabilities of the Residential and Commercial Loan Trusts (Details) - USD ($) $ in Thousands		Jun. 30, 2022	Dec. 31, 2021	Jun. 30, 2021
Variable Interest Entity [Line Items]
Cash and cash equivalents		$ 15,878	$ 40,193	$ 45,775
Residential whole loans, at fair value ($1,195,853 and $1,023,502 pledged as collateral, at fair value, respectively)		1,195,853	1,023,502
Assets Pledged		5,095	5,207
Investment related receivable		11,952	22,133
Interest receivable		12,538	11,823
Total assets	[1]	2,791,249	2,825,700
Securitized debt, net		1,962,787	1,863,488
Interest payable		10,740	10,272
Accounts payable and accrued expenses		3,585	4,842
Total liabilities	[2]	2,650,911	2,621,371
VIE
Variable Interest Entity [Line Items]
Cash and cash equivalents		0	266
Residential whole loans, at fair value ($1,195,853 and $1,023,502 pledged as collateral, at fair value, respectively)		1,195,853	1,023,502
Assets Pledged		5,095	5,207
Investment related receivable		11,906	22,087
Interest receivable		11,506	10,572
Total assets		2,482,386	2,432,064
Securitized debt, net		1,962,787	1,863,488
Interest payable		6,901	6,480
Accounts payable and accrued expenses		70	78
Total liabilities		1,970,015	1,870,306
Residential Whole-Loan And Residential Bridge Loan | VIE
Variable Interest Entity [Line Items]
Cash and cash equivalents		0	266
Residential whole loans, at fair value ($1,195,853 and $1,023,502 pledged as collateral, at fair value, respectively)		1,195,853	1,023,502
Assets Pledged		5,095	5,207
Investment related receivable		11,906	22,087
Interest receivable		6,387	5,282
Total assets		1,219,241	1,056,344
Securitized debt, net		730,087	519,118
Interest payable		1,906	1,316
Accounts payable and accrued expenses		61	69
Total liabilities		$ 732,054	$ 520,503

[1] June 30,
2022December 31, 2021 (1) Assets of consolidated VIEs included in the total assets above:   Cash and cash equivalents$— $266 Restricted cash257 260  Residential whole loans, at fair value ($1,195,853 and $1,023,502 pledged as collateral, at fair value, respectively) 1,195,853 1,023,502  Residential bridge loans, at fair value ($5,095 and $5,207 pledged as collateral, at fair value, respectively) 5,095 5,207 Securitized commercial loans, at fair value1,243,371 1,355,808  Commercial loans, at fair value ($14,398 and $14,362 pledged as collateral, at fair value, respectively) 14,398 14,362 Investment related receivable11,906 22,087 Interest receivable11,506 10,572 Total assets of consolidated VIEs$2,482,386 $2,432,064  (2) Liabilities of consolidated VIEs included in the total liabilities above:    Securitized debt, net ($1,574,468 and $1,344,370 at fair value and $164,264 and $180,116 held by affiliates, respectively) $1,962,787 $1,863,488  Interest payable (includes $699 and $699 on securitized debt held by affiliates, respectively) 6,901 6,480 Accounts payable and accrued expenses70 78 Other liabilities257 260 Total liabilities of consolidated VIEs$1,970,015 $1,870,306  (3)     Amounts have been adjusted to reflect the one-for-ten reverse stock split effected July 11, 2022. See Note 2 and Note 12 for additional details.

[2] June 30,
2022December 31, 2021 (1) Assets of consolidated VIEs included in the total assets above:   Cash and cash equivalents$— $266 Restricted cash257 260  Residential whole loans, at fair value ($1,195,853 and $1,023,502 pledged as collateral, at fair value, respectively) 1,195,853 1,023,502  Residential bridge loans, at fair value ($5,095 and $5,207 pledged as collateral, at fair value, respectively) 5,095 5,207 Securitized commercial loans, at fair value1,243,371 1,355,808  Commercial loans, at fair value ($14,398 and $14,362 pledged as collateral, at fair value, respectively) 14,398 14,362 Investment related receivable11,906 22,087 Interest receivable11,506 10,572 Total assets of consolidated VIEs$2,482,386 $2,432,064  (2) Liabilities of consolidated VIEs included in the total liabilities above:    Securitized debt, net ($1,574,468 and $1,344,370 at fair value and $164,264 and $180,116 held by affiliates, respectively) $1,962,787 $1,863,488  Interest payable (includes $699 and $699 on securitized debt held by affiliates, respectively) 6,901 6,480 Accounts payable and accrued expenses70 78 Other liabilities257 260 Total liabilities of consolidated VIEs$1,970,015 $1,870,306  (3)     Amounts have been adjusted to reflect the one-for-ten reverse stock split effected July 11, 2022. See Note 2 and Note 12 for additional details.