Separate Financial Information of Subsidiary Guarantors of Indebtedness - Schedule of Condensed Balance Sheet (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2015	Dec. 31, 2014	Mar. 31, 2014	Dec. 31, 2013
Condensed Balance Sheet Statements, Captions [Line Items]
Cash and cash equivalents	$ 338,490	$ 320,175	$ 562,704	$ 491,885
Restricted cash and cash equivalents	837,628	733,015
Residential loans at amortized cost, net	1,288,898	1,314,539
Residential loans at fair value	12,204,837	11,832,630
Receivables at fair value	248,378	215,629
Servicer and protective advances, net	1,612,988	1,761,082
Servicing Rights, Net	1,693,982	1,730,216
Goodwill	575,468	575,468
Intangible assets, net	99,583	103,503
Premises and equipment, net	115,837	124,926
Other assets	292,078	280,794
Due from affiliates, net	0	0
Investments in consolidated subsidiaries and VIEs	0	0
Total assets	19,308,167	18,991,977
Payables and accrued liabilities	669,313	663,829
Servicer payables	695,299	584,567
Servicing advance liabilities	1,284,804	1,365,885
Warehouse borrowings	1,187,543	1,176,956
Excess servicing spread liability at fair value	63,349	66,311
Corporate debt	2,266,831	2,267,799
Mortgage-backed debt	1,706,367	1,751,459
HMBS related obligations at fair value	10,304,384	9,951,895
Deferred tax liability, net	81,316	86,617
Obligation to fund Non-Guarantor VIEs	0	0
Due to affiliates, net	0	0
Total liabilities	18,259,206	17,915,318
Total stockholders' equity	1,048,961	1,076,659
Total liabilities and stockholders' equity	19,308,167	18,991,977
Parent Company [Member]
Condensed Balance Sheet Statements, Captions [Line Items]
Cash and cash equivalents	19,853	3,162	46,430	100,009
Restricted cash and cash equivalents	10,508	10,507
Residential loans at amortized cost, net	13,073	13,302
Residential loans at fair value	0	0
Receivables at fair value	29,721	16,363
Servicer and protective advances, net	0	0
Servicing Rights, Net	0	0
Goodwill	0	0
Intangible assets, net	0	0
Premises and equipment, net	172	157
Other assets	53,741	69,780
Due from affiliates, net	679,171	697,979
Investments in consolidated subsidiaries and VIEs	2,626,338	2,641,527
Total assets	3,432,577	3,452,777
Payables and accrued liabilities	51,446	42,076
Servicer payables	0	0
Servicing advance liabilities	0	0
Warehouse borrowings	0	0
Excess servicing spread liability at fair value	0	0
Corporate debt	2,265,222	2,265,668
Mortgage-backed debt	0	0
HMBS related obligations at fair value	0	0
Deferred tax liability, net	66,948	68,374
Obligation to fund Non-Guarantor VIEs	0	0
Due to affiliates, net	0	0
Total liabilities	2,383,616	2,376,118
Total stockholders' equity	1,048,961	1,076,659
Total liabilities and stockholders' equity	3,432,577	3,452,777
Guarantor Subsidiaries [Member]
Condensed Balance Sheet Statements, Captions [Line Items]
Cash and cash equivalents	313,388	311,810	513,022	388,644
Restricted cash and cash equivalents	725,383	617,774
Residential loans at amortized cost, net	7,716	8,456
Residential loans at fair value	11,636,925	11,246,197
Receivables at fair value	194,570	172,579
Servicer and protective advances, net	457,343	527,758
Servicing Rights, Net	1,693,982	1,730,216
Goodwill	575,468	575,468
Intangible assets, net	93,517	97,248
Premises and equipment, net	115,665	124,769
Other assets	196,008	164,815
Due from affiliates, net	0	0
Investments in consolidated subsidiaries and VIEs	23,974	15,756
Total assets	16,033,939	15,592,846
Payables and accrued liabilities	612,593	616,445
Servicer payables	695,299	584,567
Servicing advance liabilities	194,112	205,628
Warehouse borrowings	1,187,543	1,176,956
Excess servicing spread liability at fair value	63,349	66,311
Corporate debt	1,609	2,131
Mortgage-backed debt	0	0
HMBS related obligations at fair value	10,304,384	9,951,895
Deferred tax liability, net	11,544	15,353
Obligation to fund Non-Guarantor VIEs	35,304	32,902
Due to affiliates, net	578,801	583,331
Total liabilities	13,684,538	13,235,519
Total stockholders' equity	2,349,401	2,357,327
Total liabilities and stockholders' equity	16,033,939	15,592,846
Non-Guarantor Subsidiaries [Member]
Condensed Balance Sheet Statements, Captions [Line Items]
Cash and cash equivalents	5,249	5,203	3,252	3,232
Restricted cash and cash equivalents	101,737	104,734
Residential loans at amortized cost, net	1,268,109	1,292,781
Residential loans at fair value	567,912	586,433
Receivables at fair value	24,087	26,687
Servicer and protective advances, net	1,123,386	1,192,473
Servicing Rights, Net	0	0
Goodwill	0	0
Intangible assets, net	6,066	6,255
Premises and equipment, net	0	0
Other assets	42,329	46,199
Due from affiliates, net	0	0
Investments in consolidated subsidiaries and VIEs	0	0
Total assets	3,138,875	3,260,765
Payables and accrued liabilities	14,423	14,294
Servicer payables	0	0
Servicing advance liabilities	1,090,692	1,160,257
Warehouse borrowings	0	0
Excess servicing spread liability at fair value	0	0
Corporate debt	0	0
Mortgage-backed debt	1,706,367	1,751,459
HMBS related obligations at fair value	0	0
Deferred tax liability, net	2,788	2,869
Obligation to fund Non-Guarantor VIEs	0	0
Due to affiliates, net	100,370	114,648
Total liabilities	2,914,640	3,043,527
Total stockholders' equity	224,235	217,238
Total liabilities and stockholders' equity	3,138,875	3,260,765
Consolidation, Eliminations [Member]
Condensed Balance Sheet Statements, Captions [Line Items]
Cash and cash equivalents	0	0	0	0
Restricted cash and cash equivalents	0	0
Residential loans at amortized cost, net	0	0
Residential loans at fair value	0	0
Receivables at fair value	0	0
Servicer and protective advances, net	32,259	40,851
Servicing Rights, Net	0	0
Goodwill	0	0
Intangible assets, net	0	0
Premises and equipment, net	0	0
Other assets	0	0
Due from affiliates, net	(679,171)	(697,979)
Investments in consolidated subsidiaries and VIEs	(2,650,312)	(2,657,283)
Total assets	(3,297,224)	(3,314,411)
Payables and accrued liabilities	(9,149)	(8,986)
Servicer payables	0	0
Servicing advance liabilities	0	0
Warehouse borrowings	0	0
Excess servicing spread liability at fair value	0	0
Corporate debt	0	0
Mortgage-backed debt	0	0
HMBS related obligations at fair value	0	0
Deferred tax liability, net	36	21
Obligation to fund Non-Guarantor VIEs	(35,304)	(32,902)
Due to affiliates, net	(679,171)	(697,979)
Total liabilities	(723,588)	(739,846)
Total stockholders' equity	(2,573,636)	(2,574,565)
Total liabilities and stockholders' equity	$ (3,297,224)	$ (3,314,411)