Transactions with Affiliates - Amounts due from Affiliate (Details) - PMT - USD ($) $ in Thousands	Jun. 30, 2020	Dec. 31, 2019
Amounts due from affiliate
Allocated expenses	$ 11,867	$ 3,724
Fulfillment fees	11,549	18,285
Management fees	8,288	10,579
Correspondent production fees	7,746	10,606
Servicing fees	4,824	4,659
Interest on assets purchased under agreements to resell	45	85
Conditional Reimbursement	10	221
Total due from affiliate	44,329	48,159
Payable to affiliate
Amounts advanced by PMT	53,100	70,520
MSR Recapture Payable to PMT	202	149
Other expenses	3,256	2,611
Payable to affiliates	$ 56,558	$ 73,280