Other Assets and Liabilities - REO Information (Details) $ in Thousands	3 Months Ended
	Mar. 31, 2023 USD ($) asset	Dec. 31, 2022 asset
Other Real Estate [Roll Forward]
Balance at beginning of period	$ 6,455
Amount related to transfers into REO	8,014
Liquidations	(1,356)
Unrealized gain (loss) resulting from market valuation adjustments on REO	(18)
Balance at End of Period	13,095
Realized loss from liquidation	$ 100
Number of REO properties recorded on balance sheet | asset	30	28
Legacy Sequoia
Other Real Estate [Roll Forward]
Balance at beginning of period	$ 544
Amount related to transfers into REO	18
Liquidations	(544)
Unrealized gain (loss) resulting from market valuation adjustments on REO	0
Balance at End of Period	$ 18
Number of REO properties recorded on balance sheet | asset	1	2
Freddie Mac SLST
Other Real Estate [Roll Forward]
Balance at beginning of period	$ 2,899
Amount related to transfers into REO	381
Liquidations	(812)
Unrealized gain (loss) resulting from market valuation adjustments on REO	174
Balance at End of Period	$ 2,642
Number of REO properties recorded on balance sheet | asset	25	24
CAFL
Other Real Estate [Roll Forward]
Balance at beginning of period	$ 0
Amount related to transfers into REO	0
Liquidations	0
Unrealized gain (loss) resulting from market valuation adjustments on REO	0
Balance at End of Period	$ 0
Number of REO properties recorded on balance sheet | asset	0	0
BPL bridge loans
Other Real Estate [Roll Forward]
Balance at beginning of period	$ 3,012
Amount related to transfers into REO	7,615
Liquidations	0
Unrealized gain (loss) resulting from market valuation adjustments on REO	(192)
Balance at End of Period	$ 10,435
Number of REO properties recorded on balance sheet | asset	4	2