Condensed Consolidated Statements of Income (Unaudited) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2017	Mar. 31, 2016
Income Statement [Abstract]
Interest income	$ 292,538	$ 190,036
Interest expense	98,229	81,228
Net interest income (expense)	194,309	108,808
Impairment
Other-than-temporary impairment (OTTI) on securities	2,112	3,254
Valuation and loss provision on loans and real estate owned	17,910	6,745
Total Impairment Charges	20,022	9,999
Net interest income after impairment	174,287	98,809
Servicing revenue, net	40,602	0
Other Income
Change in fair value of investments in excess mortgage servicing rights	821	7,926
Change in fair value of investments in excess mortgage servicing rights, equity method investees	(244)	3,022
Change in fair value of investments in servicer advances	2,559	(31,224)
Gain on consumer loans investment	0	9,943
Gain on remeasurement of consumer loans investment	0	71,250
Gain (loss) on settlement of investments, net	(13,674)	(12,246)
Other income (loss), net	6,844	(16,749)
Other Income	(3,694)	31,922
Operating Expenses
General and administrative expenses	11,827	12,081
Management fee to affiliate	13,074	10,008
Incentive compensation to affiliate	12,460	1,196
Loan servicing expense	13,376	1,731
Subservicing expense	17,704	0
Total Operating Expenses	68,441	25,016
Income (Loss) Before Income Taxes	142,754	105,715
Income tax expense (benefit)	5,596	(10,223)
Net Income (Loss)	137,158	115,938
Noncontrolling Interests in Income of Consolidated Subsidiaries	15,780	4,202
Net Income Attributable to Common Stockholders	$ 121,378	$ 111,736
Net Income Per Share of Common Stock
Basic (in dollars per share)	$ 0.42	$ 0.48
Diluted (in dollars per share)	$ 0.42	$ 0.48
Weighted Average Number of Shares of Common Stock Outstanding
Basic (in shares)	286,600,324	230,471,202
Diluted (in shares)	288,241,188	230,538,712
Dividend declared per Share of Common Stock (in dollars per share)	$ 0.48	$ 0.46