Schedule I - Financial Information - Supplemental Disclosures of Cash Flow Information (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014
Supplemental Disclosure of Cash Flow Information
Cash paid for interest	$ 269,229	$ 288,648	$ 316,094
Cash paid (received) for taxes	61,881	(1,590)	(5,338)
Supplemental Disclosure of Non-Cash Investing and Financing Activities
Real estate owned acquired through foreclosure	158,690	122,911	122,213
Residential loans originated to finance the sale of real estate owned	13,389	22,022	52,130
Servicing Rights Capitalized Upon Deconsolidation Of Residual Trusts [Member]
Supplemental Disclosure of Non-Cash Investing and Financing Activities
Servicing rights capitalized upon deconsolidation of Residual Trusts	0	3,133	0
Parent Company [Member]
Supplemental Disclosure of Cash Flow Information
Cash paid for interest	123,369	128,913	132,422
Cash paid (received) for taxes	61,289	(3,318)	(6,067)
Supplemental Disclosure of Non-Cash Investing and Financing Activities
Real estate owned acquired through foreclosure	806	783	671
Residential loans originated to finance the sale of real estate owned	540	1,466	1,657
Contributions to subsidiaries	68,637	28,249	19,143
Distributions from subsidiaries	14,727	7,469	183
Parent Company [Member] | Servicing Rights Capitalized Upon Deconsolidation Of Residual Trusts [Member]
Supplemental Disclosure of Non-Cash Investing and Financing Activities
Servicing rights capitalized upon deconsolidation of Residual Trusts	$ 0	$ 3,133	$ 0