CONSOLIDATED BALANCE SHEETS (Parenthetical) - USD ($)	Mar. 31, 2020	Dec. 31, 2019
Residential mortgage loans held-for-securitization, allowance	$ 56,000	$ 0
Residential mortgage loans held-for-investment, allowance	$ 167,000	$ 175,000
Series B Cumulative Convertible Preferred Stock, par value	$ 0.01	$ 0.01
Series B Cumulative Convertible Preferred Stock, liquidating preference per share	$ 25.00	$ 25.00
Series B Cumulative Convertible Preferred Stock, liquidating preference	$ 19,494,000	$ 19,494,000
Series B Cumulative Convertible Preferred Stock, shares issued	779,743	780,000
Series B Cumulative Convertible Preferred Stock, shares outstanding	779,743	780,000
Common Stock, par value	$ 0.01	$ 0.01
Common Stock, authorized	200,000,000	200,000,000
Common Stock, issued	98,936,157	98,849,000
Common Stock, outstanding	98,936,157	98,849,000
Total assets	$ 3,551,011,000	$ 4,938,631,000
Accrued interest receivable	12,279,000	16,398,000
Total liabilities	3,166,962,000	4,366,679,000
Accrued interest payable	11,942,000	16,757,000
Agency MBS
Financial Instruments, Owned and Pledged as Collateral, To Third Party	0	655,045,000
Agency MBS | Available-for-sale Securities
Financial Instruments, Owned and Pledged as Collateral, To Third Party	2,319,446,000	2,764,330,000
Mortgage Backed Securities Issued By Private Entities, Amortized Cost Basis	2,319,638,000	2,799,448,000
Mortgage Backed Securities Issued By Private Entities, Allowance For Credit Losses	0	0
Non-Agency MBS
Financial Instruments, Owned and Pledged as Collateral, To Third Party	277,960,000	0
Non-Agency MBS | Available-for-sale Securities
Financial Instruments, Owned and Pledged as Collateral, To Third Party	0	535,315,000
Financial Instruments, Owned and Pledged as Collateral, Allowance For Credit Losses	0	0
Financial Instruments, Owned and Pledged as Collateral, Amortized Cost Basis	$ 0	$ 613,576,000
Series A Preferred Stock
Cumulative Preferred Stock, par value	$ 0.01	$ 0.01
Cumulative Preferred Stock, liquidating preference per share	$ 25.00	$ 25.00
Cumulative Preferred Stock, liquidating preference	$ 47,984,000	$ 47,984,000
Cumulative Preferred Stock, shares issued	1,919,378	1,919,000
Cumulative Preferred Stock, shares outstanding	1,919,378	1,919,000
Series C Preferred Stock
Cumulative Preferred Stock, par value	$ 0.01	$ 0.01
Cumulative Preferred Stock, liquidating preference per share	$ 25.00	$ 25.00
Cumulative Preferred Stock, liquidating preference	$ 50,257,000	$ 50,257,000
Cumulative Preferred Stock, shares issued	2,010,278	2,010,000
Cumulative Preferred Stock, shares outstanding	2,010,278	2,010,000
Variable Interest Entities Primary Beneficiary
Total assets	$ 418,000,000	$ 460,000,000
Accrued interest receivable	1,300,000	1,500,000
Total liabilities	409,000,000	450,000,000
Accrued interest payable	$ 1,300,000	$ 1,400,000