Goodwill and Intangible Assets, Net - Schedule of Goodwill by Reportable Segment Footnotes (Details) - USD ($) $ in Thousands	3 Months Ended					12 Months Ended
	Dec. 31, 2016	Sep. 30, 2016	Jun. 30, 2016	Dec. 31, 2015	Jun. 30, 2015	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014
Goodwill [Line Items]
Goodwill impairment charges	$ 13,200	$ 91,000	$ 215,400	$ 151,000	$ 56,500	$ 319,551	$ 207,557
Reverse Mortgage [Member]
Goodwill [Line Items]
Accumulated impairment losses	138,800			138,800		138,800	138,800	$ 82,300
Goodwill impairment charges					$ 56,500	0	56,539
Servicing [Member]
Goodwill [Line Items]
Accumulated impairment losses	470,600			$ 151,000		470,600	151,000
Goodwill impairment charges	$ 13,200	$ 91,000	$ 215,400			$ 319,551	$ 151,018