Fair Value of Financial Instruments Level 3 (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2022	Jun. 30, 2021	Jun. 30, 2022
Non-Agency MBS
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance as of beginning of period	$ 706		$ 798
Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Gain (Loss) Included in Other Comprehensive Income (Loss)	28		64	[1]
Principal payments	(104)		(207)
Balance as of end of period	613		613
Non-Agency MBS | Accretion (amortization)
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Accretion (amortization)	39		86
Loans Receivable
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance as of beginning of period	3,757		4,268
Fair Value, Measurement with Unobservable Inputs Reconciliation, Recurring Basis, Asset, Gain (Loss) Included in Earnings		$ 25	18	[1]
Principal payments	(316)		(828)
Balance as of end of period	3,412		3,412
Loans Receivable | Accretion (amortization)
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Accretion (amortization)	$ (4)		$ (10)

[1] Change in fair value for mortgage loans is recorded within “unrealized gain (loss) on investments, net” in net income and change in fair value for other non-Agency MBS is recorded as unrealized gain (loss) in “other comprehensive income.”