Related Party Transactions - Schedule of Balance Sheet of Related Party Transaction (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Dec. 31, 2018
Related Party Transaction [Line Items]
Amount of transaction	$ 17,013	$ 14,587
Prepaid expenses and other assets
Related Party Transaction [Line Items]
Amount of transaction	241	4
Accounts Payable and Accrued Liabilities
Related Party Transaction [Line Items]
Amount of transaction	10
Gregory | Receivable from Servicer
Related Party Transaction [Line Items]
Amount of transaction	17,013	14,587
Gregory | Prepaid expenses and other assets
Related Party Transaction [Line Items]
Amount of transaction	687	11
Gregory | Prepaid expenses and other assets | Receivable from Servicer for REO acquisitions
Related Party Transaction [Line Items]
Amount of transaction	585
Thetis | Management fee payable
Related Party Transaction [Line Items]
Amount of transaction	1,634	881
Thetis | Prepaid expenses and other assets
Related Party Transaction [Line Items]
Amount of transaction	87
Thetis | Accrued expenses and other liabilities
Related Party Transaction [Line Items]
Amount of transaction		$ 16
Gaea | Accrued expenses and other liabilities
Related Party Transaction [Line Items]
Amount of transaction	$ 68