CONSOLIDATED STATEMENTS OF COMPREHENSIVE INCOME (LOSS) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Statement of Comprehensive Income [Abstract]
Net income (loss)	$ 364,101	$ (70,536)	$ 353,057
Other comprehensive income (loss):
Unrealized gain (loss) on mortgage-backed and credit risk transfer securities, net	83,965	(210,424)	(9,885)
Reclassification of unrealized (gain) loss on sale of mortgage-backed and credit risk transfer securities to gain (loss) on investments, net	9,072	193,162	1,508
Reclassification of amortization of net deferred (gain) loss on de-designated interest rate swaps to repurchase agreements interest expense	(23,729)	(25,839)	(25,544)
Currency translation adjustments on investment in unconsolidated venture	(1,158)	(447)	863
Total other comprehensive income (loss)	68,150	(43,548)	(33,058)
Comprehensive income (loss)	432,251	(114,084)	319,999
Less: Comprehensive (income) loss attributable to non-controlling interest	0	979	(4,032)
Less: Dividends to preferred stockholders	(44,426)	(44,426)	(28,080)
Comprehensive income (loss) attributable to common stockholders	$ 387,825	$ (157,531)	$ 287,887