Schedule of Assets and Liabilities (Details) - USD ($) $ in Thousands	Sep. 30, 2015	Dec. 31, 2014	Sep. 30, 2014	Dec. 31, 2013
Variable Interest Entity [Line Items]
Mortgage loans held for sale	$ 9,572
Mortgage servicing rights	170,447
Cash and cash equivalents	711,148	$ 627,595	$ 441,837	$ 988,705
Accrued interest receivable	47,563	54,274
Other assets	51,284	6,630
Total assets	17,046,111	18,516,800
Accounts payable and other liabilities	29,661	6,850
Warehouse lines of credit	33,172
Derivative liabilities, at fair value	418,921	244,591
Total liabilities	14,853,669	$ 16,096,004
PLS
Variable Interest Entity [Line Items]
Mortgage loans held for sale	9,572
Mortgage servicing rights	170,447
Cash and cash equivalents	20,547
Accrued interest receivable	19
Other assets	18,983
Total assets	219,568
Accounts payable and other liabilities	16,776
Warehouse lines of credit	8,709
Derivative liabilities, at fair value	41
Total liabilities	$ 25,526