Transactions with Affiliates - Amounts due from Affiliate (Details) - PMT - USD ($) $ in Thousands	Sep. 30, 2019	Dec. 31, 2018
Amounts due from affiliate
Fulfillment fees	$ 14,409	$ 10,006
Management fees	10,230	6,559
Correspondent production fees	5,501	2,071
Servicing fees	4,768	4,841
Allocated expenses	4,166	9,066
Conditional Reimbursement	582	801
Interest on assets purchased under agreements to resell	88	120
Total due from affiliate	39,744	33,464
Payable to affiliate
Deposits made by PMT	56,869	100,554
MSR Recapture Payable to PMT	162	179
Other expenses	4,831	3,898
Payable to affiliates	$ 61,862	$ 104,631