Real Estate Assets, Net - Narrative (Details) $ in Thousands	12 Months Ended
	Dec. 31, 2019 USD ($) property		Dec. 31, 2018 USD ($) property		Dec. 31, 2017 USD ($)
Real Estate [Line Items]
Number of properties owned | property	10		21
Rental Properties	$ 1,534		$ 17,635
Aggregate carrying value REO properties	$ 1,500		$ 17,600
Number of REO properties held for rental | property	6		16
Number of properties acquired through foreclosure | property	1		1
Number of properties transferred from property held for sale | property	6		12
Number of real estate properties purchased | property	2		1
Impaired REO held for sale net at NRV	$ 13,537	[1]	$ 19,402	[1]	$ 24,947
Number of held-for-sale residential properties disposed | property	109		127
Real Estate Held For Sale Improvements	$ 2,200		$ 2,200
Gain on sale of property	629		380		$ 506
Adjustment to record REO properties at lower of cost	2,100		2,700
Other Income
Real Estate [Line Items]
Gain on sale of property	$ 600		$ 400

[1] Property held-for-sale, net, includes valuation allowances of $1.8 million and $1.8 million at December 31, 2019 and December 31, 2018, respectively.