Transactions with Affiliates - Amounts due from Affiliate (Details) - PMT - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Amounts due from affiliate
Fulfillment fees	$ 17,366	$ 18,285
Allocated expenses	16,314	3,724
Management fees	9,055	10,579
Correspondent production fees	8,475	10,606
Servicing fees	4,929	4,659
Interest on assets purchased under agreements to resell	74	85
Conditional Reimbursement	10	221
Total due from affiliate	56,223	48,159
Payable to affiliate
Amounts advanced by PMT	55,769	70,520
MSR Recapture Payable to PMT	151	149
Other expenses	3,361	2,611
Payable to affiliates	$ 59,281	$ 73,280