Transactions with Affiliates and Affiliated Entities (Details)	3 Months Ended		9 Months Ended		12 Months Ended
	Sep. 30, 2019 USD ($) Loan	Sep. 30, 2018 USD ($)	Sep. 30, 2019 USD ($) Loan Employee	Sep. 30, 2018 USD ($)	Dec. 31, 2018 USD ($) Loan
Information about Related Party [Abstract]
Renew of management agreement subject to termination			1 year
Management agreement subject to termination, notice period for termination to manager			30 days
Management agreement subject to termination, period of notice by manager in the event of default			60 days
Management agreement subject to termination, period of termination fee payment in the event of default			30 days
Percentage of annual management fee paid equal to gross equity			1.50%
Subservicing of Financial Assets Agreements Additional Term			3 years
Losses on loans repurchased	$ 290,000	$ 0	$ 0	$ 0
Management fees	1,804,000	1,361,000	5,071,000	3,677,000
Compensation reimbursement	238,000	238,000	714,000	620,000
Total	$ 2,042,000	$ 1,599,000	$ 5,785,000	$ 4,297,000
Minimum [Member]
Information about Related Party [Abstract]
Management agreement subject to non-renewal, notice period			180 days
Maximum [Member]
Information about Related Party [Abstract]
Management agreement subject to non-renewal, notice period			270 days
Freedom Mortgage Excess Service Right [Member]
Information about Related Party [Abstract]
Joint marketing recapture agreement initial term			1 year
Joint marketing recapture agreement automatic renewals term			1 year
Number of MSRs loans | Loan	0		19		98
Aggregate unpaid principal balance			$ 4,400,000		$ 21,500,000
Amount due to affiliated entity			$ 5,200		32,000
Number of employees leases from mortgage | Employee			5
Remaining holdback amount	$ 757,000		$ 757,000		$ 757,000