Fair Value Measurements - Carrying Amounts and Estimated Fair Values of Financial Instruments (Details) - USD ($) $ in Thousands	Jun. 30, 2024	Mar. 31, 2024	Dec. 31, 2023	Jun. 30, 2023	Mar. 31, 2023	Dec. 31, 2022
Assets:
Restricted cash	$ 32,293		$ 21,361	$ 16,786
Loans held for sale, at fair value			17,590
Loans held for investment, net	2,619,619		2,828,123
Loans held for investment, at fair value	1,971,683		1,306,072
Mortgage servicing rights	12,229	$ 9,022	8,578	$ 9,445	$ 9,143	$ 9,238
Liabilities:
Secured financing, net	283,909		211,083
Derivative liability	374		3,665
Carrying Value
Assets:
Cash	47,366		40,566
Restricted cash	32,293		21,361
Loans held for sale, at fair value			17,590
Loans held for investment, net	2,619,619		2,828,123
Loans held for investment, at fair value	1,971,683		1,306,072
Accrued interest receivables	31,124		27,028
Mortgage servicing rights	12,229		8,578
Liabilities:
Secured financing, net	283,909		211,083
Warehouse repurchase facilities, net	237,437		334,755
Securitized debt, net	2,228,941		2,418,811
Securitized debt, at fair value	1,509,952		877,417
Derivative liability	374		3,665
Accrued interest payable	24,559		20,473
Estimate of Fair Value Measurement
Assets:
Cash	47,366		40,566
Restricted cash	32,293		21,361
Loans held for sale, at fair value			17,590
Loans held for investment, net	2,483,332		2,672,705
Loans held for investment, at fair value	1,971,683		1,306,072
Accrued interest receivables	31,124		27,028
Mortgage servicing rights	12,229		8,578
Liabilities:
Secured financing, net	287,435		212,625
Warehouse repurchase facilities, net	237,437		334,755
Securitized debt, net	2,014,525		2,155,718
Securitized debt, at fair value	1,509,952		877,417
Derivative liability	374		3,665
Accrued interest payable	24,559		20,473
Level 1 | Estimate of Fair Value Measurement
Assets:
Cash	47,366		40,566
Restricted cash	32,293		21,361
Accrued interest receivables	31,124		27,028
Liabilities:
Accrued interest payable	24,559		20,473
Level 2 | Estimate of Fair Value Measurement
Assets:
Loans held for sale, at fair value			17,590
Liabilities:
Warehouse repurchase facilities, net	237,437		334,755
Securitized debt, net	2,014,525		2,155,718
Securitized debt, at fair value	1,509,952		877,417
Derivative liability	374		3,665
Level 3 | Estimate of Fair Value Measurement
Assets:
Loans held for investment, net	2,483,332		2,672,705
Loans held for investment, at fair value	1,971,683		1,306,072
Mortgage servicing rights	12,229		8,578
Liabilities:
Secured financing, net	$ 287,435		$ 212,625