Income Taxes (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Income Taxes
Assets	$ 77,256,266	$ 85,698,354
Cash	615,522	368,815	$ 255,187	$ 317,627
Deferred tax assets and liabilities
Net deferred tax assets (liabilities)	30,598	26,452
Current
Federal	8,878	15,095	28,677
Foreign	938	6,000	5,432
State	2,192	2,532	4,946
Total current	12,008	23,627	39,055
Deferred
Federal	(2,655)	(3,799)	(9,975)
Foreign	(447)	(1,973)	(3,400)
State	(562)	(649)	(1,584)
Total deferred	(3,664)	(6,421)	(14,959)
Total	8,344	17,206	$ 24,096
U.S.
Deferred tax assets and liabilities
Reserves and accruals	6,103	11,659
Domestic intangible assets	24,450	17,734
Investment securities and loans.	(2,355)	(2,416)
Investment in unconsolidated entities	948
Investment in unconsolidated entities		(362)
Deferred income	292	423
Net operating and capital loss carryforwards	804	2,967
Valuation allowance		(2,967)
Other temporary differences (asset)	356	343
Net deferred tax assets	30,598	27,381
Europe
Deferred tax assets and liabilities
European servicing rights		(583)
Net operating and capital loss carryforwards	5,533	7,606
Valuation allowance	(5,533)	(7,606)
Other temporary differences (liability)		(346)
Net deferred tax liabilities		(929)
Deferred
Total deferred	0
Investment and Servicing Segment | TRS entities
Income Taxes
Assets	634,400	858,500,000
Cash	$ 181,000	$ 185,600