Servicing rights - Residential mortgage servicing rights (Details) - USD ($) $ in Thousands	6 Months Ended	12 Months Ended
	Jun. 30, 2020	Dec. 31, 2019	Mar. 31, 2020	Jun. 30, 2019	Mar. 31, 2019	Dec. 31, 2018
Servicing rights
Unpaid Principal Amount	$ 1,976,068	$ 1,735,493
Residential MSRs
Servicing rights
Unpaid Principal Amount	8,705,285	8,164,604
Fair Value	73,645	91,174	$ 78,631	$ 85,658	$ 88,218	$ 93,065
Possible impact of adverse changes to key assumptions
Prepayment rate (10% adverse change)	(4,532)	(4,195)
Prepayment rate (20% adverse change)	(8,719)	(8,091)
Discount rate (10% adverse change)	(2,588)	(3,450)
Discount rate (20% adverse change)	(4,998)	(6,654)
Cost of servicing (10% adverse change)	(1,446)	(1,648)
Cost of servicing (20% adverse change)	(2,892)	(3,297)
Fannie Mae | Residential MSRs
Servicing rights
Unpaid Principal Amount	3,614,646	3,388,630
Fair Value	29,789	37,309
Ginnie Mae | Residential MSRs
Servicing rights
Unpaid Principal Amount	2,592,409	2,504,993
Fair Value	23,946	29,869
Freddie Mac
Servicing rights
Unpaid Principal Amount	1,399,652	1,167,476
Possible impact of adverse changes to key assumptions
Prepayment rate (10% adverse change)	(369)	(285)
Prepayment rate (20% adverse change)	(722)	(558)
Discount rate (10% adverse change)	(470)	(381)
Discount rate (20% adverse change)	(920)	(746)
Freddie Mac | Residential MSRs
Servicing rights
Unpaid Principal Amount	2,498,230	2,270,981
Fair Value	$ 19,910	$ 23,996
Minimum | Residential MSRs
Servicing rights, valuation assumptions
Forward prepayment assumptions	11.50%	7.10%
Discount rate	9.10%	9.00%
Servicing expense	$ 70	$ 70
Minimum | Freddie Mac
Servicing rights, valuation assumptions
Forward prepayment assumptions	0.50%	0.50%
Discount rate	6.00%	6.00%
Servicing expense (as a percent)	0.20%	0.20%
Maximum | Residential MSRs
Servicing rights, valuation assumptions
Forward prepayment assumptions	22.10%	18.70%
Discount rate	12.00%	11.00%
Servicing expense	$ 85	$ 85
Maximum | Freddie Mac
Servicing rights, valuation assumptions
Forward prepayment assumptions	15.90%	15.90%
Discount rate	6.00%	6.00%
Servicing expense (as a percent)	0.30%	0.30%
Weighted Average | Residential MSRs
Servicing rights, valuation assumptions
Forward prepayment assumptions	12.90%	10.10%
Discount rate	10.00%	9.60%
Servicing expense	$ 74	$ 75
Weighted Average | Freddie Mac
Servicing rights, valuation assumptions
Forward prepayment assumptions	6.60%	6.60%
Discount rate	6.00%	6.00%
Servicing expense (as a percent)	0.20%	0.20%