Other Liabilities (Details) - USD ($) $ in Thousands	Jun. 30, 2019	Dec. 31, 2018
Other Liabilities [Abstract]
Securitized debt	$ 627,487	$ 684,420
Convertible Senior Notes	223,399	0
Senior Notes	96,838	96,816
Dividends and dividend equivalents payable	90,400	90,198
Accrued interest payable	16,865	16,280
Payable for unsettled residential whole loans purchases	86,987	211,129
Accrued expenses and other	32,101	26,296
Total Other Liabilities	$ 1,174,077	$ 1,125,139