Servicing of Residential Loans - Schedule of Geographic Diversification of Third-Party Servicing Portfolio (Details) $ in Thousands	12 Months Ended
	Dec. 31, 2016 USD ($) Account	Dec. 31, 2015 USD ($) Account
Concentration Risk [Line Items]
Number of Accounts | Account	2,064,543	2,245,708
Unpaid Principal Balance | $	$ 246,445,143	$ 266,648,244
Third Party Credit Owners [Member]
Concentration Risk [Line Items]
Number of Accounts | Account	1,967,155	2,143,664
Unpaid Principal Balance | $	$ 233,755,125	$ 253,942,712
Percentage of Total	100.00%	100.00%
California [Member] | Third Party Credit Owners [Member]
Concentration Risk [Line Items]
Number of Accounts | Account	224,408	244,708
Unpaid Principal Balance | $	$ 42,939,204	$ 46,704,146
Percentage of Total	18.40%	18.40%
Florida [Member] | Third Party Credit Owners [Member]
Concentration Risk [Line Items]
Number of Accounts | Account	163,186	180,242
Unpaid Principal Balance | $	$ 19,530,088	$ 21,714,653
Percentage of Total	8.40%	8.60%
Texas [Member] | Third Party Credit Owners [Member]
Concentration Risk [Line Items]
Number of Accounts | Account	152,485	169,167
Unpaid Principal Balance | $	$ 12,935,308	$ 14,380,328
Percentage of Total	5.50%	5.70%
Other Less Than 5% [Member] | Third Party Credit Owners [Member]
Concentration Risk [Line Items]
Number of Accounts | Account	1,427,076	1,549,547
Unpaid Principal Balance | $	$ 158,350,525	$ 171,143,585
Percentage of Total	67.70%	67.30%