Mortgage-Backed Securities - Gross Unrealized Gains (Losses) (Details) - USD ($) $ in Thousands	Mar. 31, 2025	Dec. 31, 2024
Debt Securities, Available-for-sale [Line Items]
Gross Unrealized Gain Included in Accumulated Other Comprehensive Income	$ 171,577	$ 174,374
Gross Unrealized Gain Included in Cumulative Earnings	27,421	26,022
Total Gross Unrealized Gain	198,998	200,396
Gross Unrealized Loss Included in Accumulated Other Comprehensive Income	(13,807)	(14,925)
Gross Unrealized Loss Included in Cumulative Earnings	(116,056)	(127,142)
Total Gross Unrealized Loss	(129,863)	(142,067)
Non-Agency RMBS - Senior
Debt Securities, Available-for-sale [Line Items]
Total Gross Unrealized Gain	161,398	164,600
Total Gross Unrealized Loss	(5,503)	(5,767)
Non-Agency RMBS - Subordinated
Debt Securities, Available-for-sale [Line Items]
Total Gross Unrealized Gain	21,178	20,167
Total Gross Unrealized Loss	(26,143)	(27,901)
Non-Agency RMBS - Interest-only
Debt Securities, Available-for-sale [Line Items]
Total Gross Unrealized Gain	14,364	13,164
Total Gross Unrealized Loss	(84,766)	(93,400)
Pass-through
Debt Securities, Available-for-sale [Line Items]
Total Gross Unrealized Gain	0
Total Gross Unrealized Loss	(731)
Agency RMBS - CMO
Debt Securities, Available-for-sale [Line Items]
Total Gross Unrealized Gain	25	106
Total Gross Unrealized Loss	(1,423)	(2,972)
Agency RMBS - Interest-only
Debt Securities, Available-for-sale [Line Items]
Total Gross Unrealized Gain	682	1,410
Total Gross Unrealized Loss	(4,097)	(4,220)
Agency CMBS - Project loans
Debt Securities, Available-for-sale [Line Items]
Total Gross Unrealized Gain	0	0
Total Gross Unrealized Loss	(6,492)	(7,132)
Agency CMBS - Interest-only
Debt Securities, Available-for-sale [Line Items]
Total Gross Unrealized Gain	1,351	949
Total Gross Unrealized Loss	(708)	(675)
Residential Mortgage-Backed Securities | Non-Agency RMBS - Senior
Debt Securities, Available-for-sale [Line Items]
Gross Unrealized Gain Included in Accumulated Other Comprehensive Income	161,398	164,600
Gross Unrealized Gain Included in Cumulative Earnings	0	0
Total Gross Unrealized Gain	161,398	164,600
Gross Unrealized Loss Included in Accumulated Other Comprehensive Income	(4,446)	(4,483)
Gross Unrealized Loss Included in Cumulative Earnings	(1,058)	(1,285)
Total Gross Unrealized Loss	(5,503)	(5,767)
Residential Mortgage-Backed Securities | Non-Agency RMBS - Subordinated
Debt Securities, Available-for-sale [Line Items]
Gross Unrealized Gain Included in Accumulated Other Comprehensive Income	10,179	9,774
Gross Unrealized Gain Included in Cumulative Earnings	10,999	10,393
Total Gross Unrealized Gain	21,178	20,167
Gross Unrealized Loss Included in Accumulated Other Comprehensive Income	(9,361)	(10,442)
Gross Unrealized Loss Included in Cumulative Earnings	(16,782)	(17,459)
Total Gross Unrealized Loss	(26,143)	(27,901)
Residential Mortgage-Backed Securities | Non-Agency RMBS - Interest-only
Debt Securities, Available-for-sale [Line Items]
Gross Unrealized Gain Included in Accumulated Other Comprehensive Income	0	0
Gross Unrealized Gain Included in Cumulative Earnings	14,364	13,164
Total Gross Unrealized Gain	14,364	13,164
Gross Unrealized Loss Included in Accumulated Other Comprehensive Income	0	0
Gross Unrealized Loss Included in Cumulative Earnings	(84,766)	(93,400)
Total Gross Unrealized Loss	(84,766)	(93,400)
Residential Mortgage-Backed Securities | Pass-through
Debt Securities, Available-for-sale [Line Items]
Gross Unrealized Gain Included in Accumulated Other Comprehensive Income	0
Gross Unrealized Gain Included in Cumulative Earnings	0
Total Gross Unrealized Gain	0
Gross Unrealized Loss Included in Accumulated Other Comprehensive Income	0
Gross Unrealized Loss Included in Cumulative Earnings	(731)
Total Gross Unrealized Loss	(731)
Residential Mortgage-Backed Securities | Agency RMBS - CMO
Debt Securities, Available-for-sale [Line Items]
Gross Unrealized Gain Included in Accumulated Other Comprehensive Income	0	0
Gross Unrealized Gain Included in Cumulative Earnings	25	106
Total Gross Unrealized Gain	25	106
Gross Unrealized Loss Included in Accumulated Other Comprehensive Income	0	0
Gross Unrealized Loss Included in Cumulative Earnings	(1,423)	(2,972)
Total Gross Unrealized Loss	(1,423)	(2,972)
Residential Mortgage-Backed Securities | Agency RMBS - Interest-only
Debt Securities, Available-for-sale [Line Items]
Gross Unrealized Gain Included in Accumulated Other Comprehensive Income	0	0
Gross Unrealized Gain Included in Cumulative Earnings	682	1,410
Total Gross Unrealized Gain	682	1,410
Gross Unrealized Loss Included in Accumulated Other Comprehensive Income	0	0
Gross Unrealized Loss Included in Cumulative Earnings	(4,097)	(4,220)
Total Gross Unrealized Loss	(4,097)	(4,220)
Commercial Mortgage Backed Securities | Agency CMBS - Project loans
Debt Securities, Available-for-sale [Line Items]
Gross Unrealized Gain Included in Accumulated Other Comprehensive Income	0	0
Gross Unrealized Gain Included in Cumulative Earnings	0	0
Total Gross Unrealized Gain	0	0
Gross Unrealized Loss Included in Accumulated Other Comprehensive Income	0	0
Gross Unrealized Loss Included in Cumulative Earnings	(6,492)	(7,132)
Total Gross Unrealized Loss	(6,492)	(7,132)
Commercial Mortgage Backed Securities | Agency CMBS - Interest-only
Debt Securities, Available-for-sale [Line Items]
Gross Unrealized Gain Included in Accumulated Other Comprehensive Income	0	0
Gross Unrealized Gain Included in Cumulative Earnings	1,351	949
Total Gross Unrealized Gain	1,351	949
Gross Unrealized Loss Included in Accumulated Other Comprehensive Income	0	0
Gross Unrealized Loss Included in Cumulative Earnings	(708)	(675)
Total Gross Unrealized Loss	$ (708)	$ (675)