Consolidated Balance Sheets (Parenthetical) - USD ($) $ in Thousands	Dec. 31, 2016	Dec. 31, 2015
Allowance for loan losses	$ 5,167	$ 4,457
Receivables at fair value	15,033	16,542
Allowance for uncollectible advances	146,781	120,338
Servicing rights at fair value	949,593	1,682,016
Other assets at fair value	87,937	58,512
Payables and accrued liabilities at fair value	11,804	6,475
Mortgage-backed debt at fair value	$ 514,025	$ 582,340
Preferred stock, par value (in dollars per share)	$ 0.01	$ 0.01
Preferred stock, shares authorized	10,000,000	10,000,000
Preferred stock, shares issued	0	0
Preferred stock, shares outstanding	0	0
Common stock, par value (in dollars per share)	$ 0.01	$ 0.01
Common stock, shares authorized	90,000,000	90,000,000
Common stock, shares issued	36,391,129	35,573,405
Common stock, shares outstanding	36,391,129	35,573,405
Variable Interest Entity, Primary Beneficiary [Member]
Mortgage-backed debt at fair value	$ 514,025	$ 582,340