CONSOLIDATED STATEMENTS OF CASH FLOWS (Unaudited) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2018	Mar. 31, 2017
Operating activities:
Net income	$ 37,068	$ 23,944
Adjustments to reconcile net income to net cash provided by operating activities:
Depreciation and amortization	1,846	1,897
Stock-based compensation	2,545	2,305
Amortization and accretion of interest and fees, net	3,945	742
Amortization of capitalized mortgage servicing rights	11,865	11,888
Originations of loans held-for-sale	(1,035,737)	(1,267,713)
Proceeds from sales of loans held-for-sale, net of gain on sale	1,046,204	1,364,850
Mortgage servicing rights	(19,634)	(20,030)
Write-off of capitalized mortgage servicing rights from payoffs	4,811	3,393
Impairment loss on real estate owned		1,200
Provision for loan losses (net of recoveries)	325	(696)
Provision for loss sharing (net of recoveries)	473	1,679
Net charge-offs for loss sharing obligations	113	(1,867)
Gain on extinguishment of debt		(7,116)
Deferred tax (benefit) provision	(13,320)	1,827
Income from equity affiliates	(746)	(763)
Changes in operating assets and liabilities	(18,961)	(42,967)
Net cash provided by operating activities	20,797	72,573
Investing Activities:
Loans and investments funded and originated, net	(283,937)	(138,952)
Payoffs and paydowns of loans and investments	192,023	191,752
Deferred fees	2,827	227
Investments in real estate, net	(66)	(119)
Contributions to equity affiliates	(2,460)	(348)
Distributions from equity affiliates	2,608	385
Purchase of securities held-to-maturity, net	(8,445)	(7,838)
Payoffs and paydowns of securities held-to-maturity	139	2
Proceeds from insurance settlements	2,278	647
Due to borrowers and reserves	(63,941)	(753)
Net cash (used in) provided by investing activities	(158,974)	45,003
Financing activities:
Proceeds from repurchase agreements, loan participations, credit facilities and notes payable	1,870,249	2,439,585
Payoffs and paydowns of repurchase agreements, loan participations and credit facilities	(1,771,463)	(2,491,430)
Payoffs of junior subordinated notes to subsidiary trust issuing preferred securities		(12,691)
Payoff of related party financing	(50,000)
Proceeds from convertible senior unsecured notes		13,750
Proceeds from senior unsecured notes	100,000
Receipts on swaps and returns of margin calls from counterparties		430
Distributions paid on common stock	(12,962)	(8,738)
Distributions paid on noncontrolling interest	(4,458)	(3,609)
Distributions paid on preferred stock	(1,888)	(1,888)
Distributions paid on preferred stock of private REIT	(5)	(5)
Payment of deferred financing costs	(3,875)	(834)
Proceeds from issuance of common stock, net	3,014
Net cash provided by ( used in ) financing activities	128,612	(65,430)
Net (decrease) increase in cash, cash equivalents and restricted cash	(9,565)	52,146
Cash, cash equivalents and restricted cash at beginning of period	243,772	167,960
Cash, cash equivalents and restricted cash at end of period	234,207	220,106
Supplemental cash flow information:
Cash used to pay interest	27,507	15,014
Cash used to pay taxes	3,718	750
8.25% Series A preferred stock
Supplemental schedule of non-cash investing and financing activities:
Distributions accrued on preferred stock	267	267
7.75% Series B preferred stock
Supplemental schedule of non-cash investing and financing activities:
Distributions accrued on preferred stock	203	203
8.50% Series C preferred stock
Supplemental schedule of non-cash investing and financing activities:
Distributions accrued on preferred stock	$ 159	$ 159