Real Estate Assets, Net - Schedule of REO Held-For-Sale (Details) $ in Thousands		12 Months Ended
		Dec. 31, 2019 USD ($) property		Dec. 31, 2018 USD ($) property
Real Estate Held For Sale [Roll Forward]
Balance at beginning of year | property		102		136
Balance at beginning of period | $		$ 19,402	[1]	$ 24,947
Transfers from mortgage loans, count | property		61		93
Real Estate Owned, Transfer to Real Estate Owned | $		$ 12,104		$ 15,072
Adjustments to record at lower of cost or fair value, count | property		0		0
Adjustments to record at lower of cost or fair value  | $		$ (2,104)		$ (2,700)
Disposals, count | property		(109)		(127)
Disposals | $		$ (16,819)		$ (17,251)
Transfer from rental property, count | property		6		6
Transfer from rental property | $		$ 1,613		$ 549
Transfer to rental property, count | property		(2)		(6)
Transfer to rental property | $		$ (414)		$ (1,140)
Other, count | property		0		0
Other | $		$ (245)		$ (75)
Balance at end of period , count | property		58		102
Balance at end of year | $	[1]	$ 13,537		$ 19,402

[1] Property held-for-sale, net, includes valuation allowances of $1.8 million and $1.8 million at December 31, 2019 and December 31, 2018, respectively.