Loans Held for Investment and Loans Held for Investment at Fair Value - Summary of Difference Between Aggregate Fair Value and Aggregate Unpaid Principal Balance by Loan Segments (Details) - Nonaccrual Status - USD ($) $ in Thousands	Jun. 30, 2024	Dec. 31, 2023
Financing Receivable, Past Due [Line Items]
Fair Value	$ 1,971,683	$ 1,306,072
Unpaid Principal Balance	1,880,885	1,251,395
Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	1,849,454	1,245,499
Unpaid Principal Balance	1,734,100	1,178,617
90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	122,229	60,573
Unpaid Principal Balance	146,785	72,778
Difference	(24,556)	(12,205)
Commercial - Purchase
Financing Receivable, Past Due [Line Items]
Fair Value	359,354	208,933
Unpaid Principal Balance	332,359	194,559
Commercial - Purchase | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	351,328	204,282
Unpaid Principal Balance	322,674	188,924
Commercial - Purchase | 90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	8,026	4,651
Unpaid Principal Balance	9,685	5,635
Difference	(1,659)	(984)
Commercial - Refinance
Financing Receivable, Past Due [Line Items]
Fair Value	413,247	237,433
Unpaid Principal Balance	379,262	219,678
Commercial - Refinance | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	401,470	230,034
Unpaid Principal Balance	365,119	210,716
Commercial - Refinance | 90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	11,777	7,399
Unpaid Principal Balance	14,143	8,962
Difference	(2,366)	(1,563)
Residential 1-4 Unit - Purchase
Financing Receivable, Past Due [Line Items]
Fair Value	341,547	251,101
Unpaid Principal Balance	334,151	246,922
Residential 1-4 Unit - Purchase | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	320,969	238,215
Unpaid Principal Balance	309,173	231,494
Residential 1-4 Unit - Purchase | 90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	20,578	12,886
Unpaid Principal Balance	24,978	15,428
Difference	(4,400)	(2,542)
Residential 1-4 Unit - Refinance
Financing Receivable, Past Due [Line Items]
Fair Value	723,235	501,950
Unpaid Principal Balance	699,160	483,899
Residential 1-4 Unit - Refinance | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	652,918	472,615
Unpaid Principal Balance	614,884	448,780
Residential 1-4 Unit - Refinance | 90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	70,317	29,335
Unpaid Principal Balance	84,276	35,119
Difference	(13,959)	(5,784)
Short Term 1-4 Unit - Purchase
Financing Receivable, Past Due [Line Items]
Fair Value	67,281	48,081
Unpaid Principal Balance	67,994	47,838
Short Term 1-4 Unit - Purchase | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	63,336	46,312
Unpaid Principal Balance	63,285	45,695
Short Term 1-4 Unit - Purchase | 90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	3,945	1,769
Unpaid Principal Balance	4,709	2,143
Difference	(764)	(374)
Short Term 1-4 Unit - Refinance
Financing Receivable, Past Due [Line Items]
Fair Value	67,019	58,574
Unpaid Principal Balance	67,959	58,499
Short Term 1-4 Unit - Refinance | Current to 89 Days Past Due
Financing Receivable, Past Due [Line Items]
Fair Value	59,433	54,041
Unpaid Principal Balance	58,965	53,008
Short Term 1-4 Unit - Refinance | 90+days Past Due or Nonaccrual
Financing Receivable, Past Due [Line Items]
Fair Value	7,586	4,533
Unpaid Principal Balance	8,994	5,491
Difference	$ (1,408)	$ (958)