Transactions with Affiliates - Financing Activities (Details) - USD ($)	3 Months Ended
	Mar. 31, 2020	Mar. 31, 2019	Dec. 31, 2019	Feb. 01, 2013
Financing activities:
Issuance pursuant to recapture agreement	$ 379,000	$ 508,000
Repayments	9,308,000	10,552,000
PMT
Financing activities:
Gain (loss) recognized	14,522,000	4,051,000
Interest expense	1,974,000	3,066,000
Excess servicing spread financing at fair value payable to affiliate	157,109,000		$ 178,586,000
PMT | 2/1/13 Spread Acquisition Agreement
Financing activities:
Maximum ESS recapture obligation				$ 200,000
Excess servicing spread financing
Financing activities:
Gain (loss) recognized	(14,522,000)	(4,051,000)
Excess servicing spread financing | PMT
Financing activities:
Issuance pursuant to recapture agreement	379,000	508,000
Repayments	9,308,000	10,552,000
Gain (loss) recognized	14,522,000	4,051,000
Interest expense	1,974,000	3,066,000
Excess servicing spread recapture recognized	381,000	$ 489,000
Excess servicing spread financing at fair value payable to affiliate	$ 157,109,000		$ 178,586,000