Related Party Transactions - Mortgage Loan Servicing (Details)			3 Months Ended
	Jun. 30, 2020	Sep. 12, 2016 USD ($) item	Mar. 31, 2021 USD ($)	Mar. 31, 2020 USD ($)
Loan Servicing Agreement
Transactions with Affiliates
Base servicing fees per month for REO		$ 75
Rental fee per month per REO		30
Renewal fee, per lease renewal, on REO property		$ 100
Property management fees on REOs, as a percent of gross rental income		9.00%
Base servicing fees per month for fixed-rate non-distressed loans subserviced		$ 7.50
Base servicing fees per month for adjustable rate non-distressed loans subserviced		8.50
Supplemental fee per month for each distressed whole loan		25
Activity-based fee, percent, due to a streamline modification		750
Activity-based fee, percent, due to a liquidation		1,750
Activity-based fee due to a deed-in-lieu of foreclosure		$ 500
Maximum number of liquidation, reperformance, or modification fees that can be earned during earnable period | item		1
Liquidation, reperformance, or modification fees earnable period		18 months
Minimum | Loan Servicing Agreement
Transactions with Affiliates
Servicing fees amount per month for current loans		$ 30
Additional servicing fee amount per month for delinquent loans		10
Maximum | Loan Servicing Agreement
Transactions with Affiliates
Servicing fees amount per month for severely delinquent loans		95
Additional servicing fee amount per month for delinquent loans		$ 55
PMT
Summary of mortgage loan servicing fees earned
Loan servicing fees			$ 19,093,000	$ 14,521,000
PMT | Loan Servicing Agreement
Summary of mortgage loan servicing fees earned
Related party transaction, renewal period	5 years
PMT | Loans acquired for sale at fair value
Summary of mortgage loan servicing fees earned
Loan servicing fees			543,000	536,000
PMT | Loans at fair value
Summary of mortgage loan servicing fees earned
Loan servicing fees			137,000	300,000
PMT | Mortgage servicing rights
Summary of mortgage loan servicing fees earned
Loan servicing fees			$ 18,413,000	$ 13,685,000