Fair Value (Details 2) (USD $) In Thousands, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2014	Jun. 30, 2013	Jun. 30, 2014	Jun. 30, 2013
Total realized and unrealized (losses) gains:
OTTI/Impairment	$ (797)	$ (359)	$ (1,010)	$ (401)
Net accretion			11,680	16,568
Level III
Total realized and unrealized (losses) gains:
OTTI/Impairment		(359)	(213)	(402)
Net accretion	3,323	5,755	9,887	11,906
Changes in financial instruments classified as Level III
Balance at the beginning of the period	115,719,493	321,043	102,414,703	333,153
Acquisition of LNR		89,471,477		89,471,477
Total realized and unrealized (losses) gains:
Included in earnings: Change in fair value / gain on sale	(3,313,202)	(3,698,024)	6,871,380	(3,698,024)
Total realized and unrealized (losses) gains		18		2,147
Included in OCI	(6,623)	(9,195)	(2,408)	37
Purchases / Originations	363,306	410,798	628,962	410,798
Sales	(318,305)	(486,408)	(645,920)	(499,120)
Issuances	(25,995)		(71,756)
Cash repayments / receipts	39,892	63,847	66,938	46,980
Transfers into level III	(1,978,045)	(373,699)	(2,502,357)	(373,699)
Transfers out of level III	292,058	149,184	598,900	149,184
Consolidations of VIEs	3,652,113	10,495,494	22,091,873	10,495,494
Deconsolidations of VIEs	(4,716,286)	(584,997)	(6,005,500)	(584,997)
Balance at the end of the period	109,711,729	95,764,934	109,711,729	95,764,934
Amount of total gains (losses) included in earnings attributable to assets still held at period end	(3,331,266)	(3,702,442)	(6,906,883)	(3,694,763)
VIE Liabilities | Level III
Changes in financial liabilities classified as Level III
Balance at the beginning of the period	(3,482,922)		(1,597,984)
Acquisition of LNR		(1,994,243)		(1,994,243)
Total realized and unrealized (losses) gains:
Included in earnings: Change in fair value/ gain on sale	(1,664)	94,448	99,837	94,448
Issuances	(25,995)		(71,756)
Cash repayments / receipts	50,984	79,735	86,349	79,735
Transfers into Level III	(1,983,525)	(489,513)	(2,555,137)	(489,513)
Transfers out of Level III	293,115	152,683	712,856	152,683
Consolidations of VIEs	(68,772)	(178,631)	(1,892,944)	(178,631)
Deconsolidations of VIEs	32,654	861	32,654	861
Balance at the end of the period	(5,186,125)	(2,334,660)	(5,186,125)	(2,334,660)
Amount of total gains (losses) included in earnings attributable to assets still held at period end	(1,664)	94,448	99,837	94,448
Loans Held-for-sale | Level III
Changes in financial assets classified as Level III
Balance at the beginning of the period	74,117		206,672
Acquisition of LNR		256,502		256,502
Total realized and unrealized (losses) gains:
Included in earnings: Change in fair value / gain on sale	11,546	458	32,439	458
Purchases / Originations	320,566	390,669	582,391	390,669
Sales	(251,612)	(476,336)	(554,073)	(476,336)
Cash repayments / receipts	(205)	(117)	(297)	(117)
Transfers out of Level III			(112,720)
Balance at the end of the period	154,412	171,176	154,412	171,176
Amount of total gains (losses) included in earnings attributable to assets still held at period end	688	(8,344)	688	(8,344)
RMBS | Level III
Changes in financial assets classified as Level III
Balance at the beginning of the period	291,217	321,043	296,236	333,153
Total realized and unrealized (losses) gains:
Included in earnings: Change in fair value / gain on sale	10,130		11,141
Total realized and unrealized (losses) gains				2,129
OTTI/Impairment		(359)	(213)	(402)
Net accretion	3,323	5,755	9,887	11,906
Included in OCI	(9,363)	(11,103)	(4,615)	(1,871)
Purchases / Originations		20,090		20,090
Sales	(53,236)		(62,546)	(12,712)
Cash repayments / receipts	(10,466)	(15,771)	(18,285)	(32,638)
Balance at the end of the period	231,605	319,655	231,605	319,655
Amount of total gains (losses) included in earnings attributable to assets still held at period end	2,804	6,627	7,971	14,306
CMBS | Level III
Changes in financial assets classified as Level III
Balance at the beginning of the period	240,665		208,006
Acquisition of LNR		62,432		62,432
Total realized and unrealized (losses) gains:
Included in earnings: Change in fair value / gain on sale	4,393	(1,187)	9,600	(1,187)
Total realized and unrealized (losses) gains		18		18
Included in OCI	2,740	1,908	2,207	1,908
Purchases / Originations	42,740	39	46,571	39
Sales	(13,457)	(10,072)	(29,301)	(10,072)
Cash repayments / receipts	(421)		(829)
Transfers into Level III	5,480	115,814	52,780	115,814
Transfers out of Level III		(3,499)	(179)	(3,499)
Consolidations of VIEs			(6,715)
Deconsolidations of VIEs	221	(1,054)	221	(1,054)
Balance at the end of the period	282,361	164,399	282,361	164,399
Amount of total gains (losses) included in earnings attributable to assets still held at period end	4,513	(3,430)	9,018	(3,430)
Domestic Servicing Rights | Level III
Changes in financial assets classified as Level III
Balance at the beginning of the period	144,898		150,149
Acquisition of LNR		156,993		156,993
Total realized and unrealized (losses) gains:
Included in earnings: Change in fair value / gain on sale	(5,523)	2,898	(10,774)	2,898
Transfers out of Level III	(1,057)		(1,057)
Balance at the end of the period	138,318	159,891	138,318	159,891
Amount of total gains (losses) included in earnings attributable to assets still held at period end	(5,523)	2,898	(10,774)	2,898
VIE Assets | Level III
Changes in financial assets classified as Level III
Balance at the beginning of the period	118,451,518		103,151,624
Acquisition of LNR		90,989,793		90,989,793
Total realized and unrealized (losses) gains:
Included in earnings: Change in fair value / gain on sale	(3,332,084)	(3,794,641)	(7,013,623)	(3,794,641)
Consolidations of VIEs	3,720,885	10,674,125	23,991,532	10,674,125
Deconsolidations of VIEs	(4,749,161)	(584,804)	(6,038,375)	(584,804)
Balance at the end of the period	114,091,158	97,284,473	114,091,158	97,284,473
Amount of total gains (losses) included in earnings attributable to assets still held at period end	$ (3,332,084)	$ (3,794,641)	$ (7,013,623)	$ (3,794,641)