Consolidated Statements of Cash Flows - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Cash flows from operating activities
Net income before noncontrolling interests	$ 173,230	$ 160,942	$ 211,834
Adjustments to reconcile net income to net cash provided by (used in) operating activities:
Gains attributable to the fair value of future servicing rights, net of guaranty obligation	(180,766)	(172,401)	(193,886)
Change in the fair value of premiums and origination fees	6,041	(5,037)	5,781
Amortization and depreciation	152,472	142,134	131,246
Stock compensation-equity and liability classified	24,075	23,959	21,134
Provision (benefit) for credit losses	7,273	808	(243)
Deferred tax expense (benefit)	22,012	17,483	(30,961)
Originations of loans held for sale	(15,746,949)	(15,153,003)	(17,018,424)
Sales of loans to third parties	16,007,910	15,050,932	17,937,915
Amortization of deferred loan fees and costs	(6,587)	(1,742)	(2,298)
Amortization of debt issuance costs and debt discount	5,451	7,509	4,886
Origination fees received from loans held for investment	2,553	3,968	1,109
Cash paid for cloud computing implementation costs	(6,194)
Changes in:
Receivables, net	(2,298)	(4,532)	(12,234)
Other assets	(20,924)	(6,861)	(7,064)
Other liabilities	2,601	(13,957)	22,866
Performance deposits from borrowers	(12,339)	13,874	(4,019)
Net cash provided by (used in) operating activities	427,561	64,076	1,067,642
Cash flows from investing activities
Capital expenditures	(4,711)	(4,722)	(5,207)
Purchase of equity-method investments	(923)
Proceeds from the sale of equity-method investments		4,993
Purchase of pledged available-for-sale ("AFS") securities	(30,611)	(98,442)	(6,966)
Proceeds from prepayment of pledged debt AFS securities	22,756
Funding of preferred equity investments		(41,100)	(16,884)
Proceeds from the payoff of preferred equity investments		82,819
Distributions from (investments in) joint ventures, net	(15,944)	(4,137)	(6,342)
Acquisitions, net of cash received	(7,180)	(53,249)	(15,000)
Purchase of mortgage servicing rights		(1,814)	(7,781)
Originations of loans held for investment	(362,924)	(597,889)	(183,916)
Principal collected on loans held for investment upon payoff	319,832	161,303	219,516
Sales of loans held for investment			119,750
Net cash provided by (used in) investing activities	(79,705)	(552,238)	97,170
Cash flows from financing activities
Borrowings (repayments) of warehouse notes payable, net	(367,864)	139,298	(955,040)
Borrowings of interim warehouse notes payable	179,765	145,043	140,341
Repayments of interim warehouse notes payable	(67,871)	(61,050)	(237,912)
Repayments of note payable	(2,250)	(166,223)	(1,104)
Borrowings of note payable		298,500
Secured borrowings		70,052
Proceeds from issuance of common stock	5,511	8,949	3,013
Repurchase of common stock	(30,676)	(68,832)	(34,899)
Cash dividends paid	(37,272)	(31,445)
Payment of contingent consideration	(6,450)	(5,150)
Debt issuance costs	(4,531)	(7,312)	(3,890)
Net cash provided by (used in) financing activities	(331,638)	321,830	(1,089,491)
Net increase (decrease) in cash, cash equivalents, restricted cash, and restricted cash equivalents (NOTE 2)	16,218	(166,332)	75,321
Cash, cash equivalents, restricted cash, and restricted cash equivalents at beginning of period	120,348	286,680	211,359
Total of cash, cash equivalents, restricted cash, and restricted cash equivalents at end of period	136,566	120,348	286,680
Supplemental Disclosure of Cash Flow Information:
Cash paid to third parties for interest	63,564	56,430	56,267
Cash paid for income taxes	$ 39,908	$ 45,728	$ 45,524