Income Taxes (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		9 Months Ended
	Sep. 30, 2013	Sep. 30, 2012	Sep. 30, 2013	Sep. 30, 2012
Current
Federal	$ 11,465	$ 244	$ 21,396	$ 682
Foreign	1,011		1,581
State	1,892	57	3,753	158
Total current	14,368	301	26,730	840
Deferred
Federal	59		122
Foreign	(716)		(1,181)
State	10		20
Total deferred	(647)		(1,039)
Total income tax provision	13,721	301	25,691	840
Deferred tax asset, net
Reserves and accruals	10,595		10,595
Domestic intangible assets	(4,844)		(4,844)
Investment securities and loans	(165)		(165)
Investment in unconsolidated entities	(2,102)		(2,102)
Deferred income	39		39
Other U.S. temporary differences	(287)		(287)
Deferred tax assets	3,236		3,236
Deferred tax liability, net
European servicing rights	(7,368)		(7,368)
Net operating and capital loss carryforwards	9,935		9,935
Valuation allowance	(9,935)		(9,935)
Other European temporary differences	215		215
Deferred tax liabilities, net	(7,153)		(7,153)
Net deferred tax asset (liabilities)	(3,917)		(3,917)
Reconciliation of statutory tax to effective tax
Federal statutory tax rate	36,933	17,725	85,489	51,131
REIT and other non-taxable income	(24,886)	(17,481)	(62,818)	(50,449)
State income taxes	1,902	57	3,774	158
Federal benefit of state tax deduction	(666)		(1,321)
Other	438		567
Effective tax rate	$ 13,721	$ 301	$ 25,691	$ 840
Reconciliation of statutory tax rate to effective tax rate
Federal statutory tax rate (as a percent)	35.00%	35.00%	35.00%	35.00%
REIT and other non-taxable income (as a percent)	(23.60%)	(34.50%)	(25.70%)	(34.50%)
State income taxes (as a percent)	1.80%	0.10%	1.50%	0.10%
Federal benefit of state tax deduction (as a percent)	(0.60%)		(0.50%)
Other (as a percent)	0.40%		0.20%
Effective tax rate (as a percent)	13.00%	0.60%	10.50%	0.60%