Consolidated Statements of Cash Flows - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014
Cash Flows from Operating Activities:
Net income	$ 367,651	$ 452,183	$ 500,538
Adjustments to reconcile net income to net cash provided by operating activities:
Amortization of deferred financing costs, premiums and discounts on secured financing agreements and secured borrowings on transferred loans	16,190	14,617	10,854
Amortization of discounts and deferred financing costs on senior notes	21,667	20,832	14,665
Accretion of net discount on investment securities	(16,527)	(24,556)	(25,023)
Accretion of net deferred loan fees and discounts	(48,384)	(36,862)	(21,286)
Share-based compensation	32,633	32,146	28,622
Share-based component of incentive fees	17,835	17,379	11,123
Change in fair value of fair value option investment securities	1,401	(3,084)	(15,077)
Change in fair value of consolidated VIEs	28,734	45,646	(52,559)
Change in fair value of servicing rights	47,149	12,605	16,787
Change in fair value of loans held-for-sale	(74,251)	(64,320)	(70,420)
Change in fair value of derivatives	(75,122)	(28,549)	(24,646)
Foreign currency loss, net	33,660	37,110	29,366
Gain on sale of investments and other assets	(1,942)	(22,664)	(13,829)
Other-than-temporary impairment	728		1,056
Loan loss allowance, net	3,759	(2)	2,047
Depreciation and amortization	61,571	27,232	16,622
Earnings from unconsolidated entities	(21,723)	(26,674)	(19,932)
Distributions of earnings from unconsolidated entities	19,983	23,082	15,245
Bargain purchase gain	(8,406)
Loss on extinguishment of debt	8,781	5,921
Origination and purchase of loans held-for-sale, net of principal collections	(1,669,543)	(1,848,141)	(1,785,050)
Proceeds from sale of loans held-for-sale	1,884,352	2,100,216	1,670,522
Changes in operating assets and liabilities:
Related-party payable, net	(3,137)	204	22,958
Accrued and capitalized interest receivable, less purchased interest	(76,071)	(65,972)	(52,514)
Other assets	12,383	(28,485)	1,591
Accounts payable, accrued expenses and other liabilities	(6,741)	(27,358)	(40,951)
Net cash provided by operating activities	556,630	612,506	220,709
Cash Flows from Investing Activities:
Origination and purchase of loans held-for-investment	(2,815,333)	(2,360,225)	(3,034,696)
Proceeds from principal collections on loans	2,665,050	1,552,422	1,192,823
Proceeds from loans sold	382,881	637,124	501,988
Purchase of investment securities	(360,341)	(182,018)	(189,422)
Proceeds from sales of investment securities	18,725	6,410	100,166
Proceeds from principal collections on investment securities	108,790	428,569	54,295
Real estate business combinations, net of cash acquired	(849,950)	(555,051)
Proceeds from sale of properties		35,576	1,784
Additions to properties and other assets	(15,963)	(1,920)	(37,879)
Investment in unconsolidated entities	(11,148)	(32,436)	(183,043)
Distribution of capital from unconsolidated entities	15,895	30,855	62,013
Payments for purchase or termination of derivatives	(27,820)	(27,054)	(19,928)
Proceeds from termination of derivatives	85,614	36,547	5,996
Return of investment basis in purchased derivative asset	272	337	1,513
(Increase) decrease in restricted cash, net	(9,494)	30,069	2,268
Spin-off of Starwood Waypoint Residential Trust			(111,960)
Acquisition and improvement of single family homes			(61,901)
Proceeds from sale of non-performing loans			1,153
Net cash used in investing activities	(812,822)	(400,795)	(1,714,830)
Cash Flows from Financing Activities:
Borrowings under financing agreements	6,024,032	4,856,319	4,742,285
Principal repayments on and repurchases of borrowings	(5,266,115)	(4,335,654)	(3,419,957)
Payment of deferred financing costs	(37,304)	(21,701)	(16,514)
Proceeds from common stock issuances	449,230	326,428	600,998
Payment of equity offering costs	(718)	(945)	(1,535)
Payment of dividends	(458,351)	(446,847)	(401,661)
Contributions from non-controlling interests	11,387	71
Distributions to non-controlling interests	(6,934)	(2,121)	(33,880)
Purchase of treasury stock	(19,723)	(48,746)	(12,993)
Issuance of debt of consolidated VIEs	35,728	9,132	89,354
Repayment of debt of consolidated VIEs	(283,038)	(464,243)	(136,115)
Distributions of cash from consolidated VIEs	57,293	34,724	27,531
Net cash provided by (used in) financing activities	505,487	(93,583)	1,437,513
Net (decrease) increase in cash and cash equivalents	249,295	118,128	(56,608)
Cash and cash equivalents, beginning of period	368,815	255,187	317,627
Effect of exchange rate changes on cash	(2,588)	(4,500)	(5,832)
Cash and cash equivalents, end of period	615,522	368,815	255,187
Supplemental disclosure of cash flow information:
Cash paid for interest	185,053	160,386	131,917
Income taxes paid	9,742	29,171	34,611
Supplemental disclosure of non-cash investing and financing activities:
Fair value of assets acquired, net of cash	1,043,112	883,172
Fair value of liabilities assumed	184,756	328,121
Net assets acquired from consolidated VIEs	181,715	125,309
Net assets divested of Europe servicing and advisory business, net of cash	1,438
Equity interest acquired in Situs Group Holdings Corporation	12,234
Dividends declared, but not yet paid	125,075	114,947	108,189
Consolidation of VIEs (VIE asset/liability additions)	21,289,873	12,050,421	29,363,132
Deconsolidation of VIEs (VIE asset/liability reductions)	5,717,982	7,825,212	9,392,128
Settlement of loans transferred as secured borrowings	68,206	94,446	50,260
Unsettled derivative transactions	$ 28,472
Net assets acquired through foreclosure		$ 14,530
Net assets distributed in spin-off of Starwood Waypoint Residential Trust			1,008,377
Contributions from non-controlling interests			$ 7,267