Loans Held for Investment - Schedule of Delinquencies in the Company's Loan Portfolio (Details) - USD ($) $ in Thousands	Dec. 31, 2024	Dec. 31, 2023
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	$ 12,056,183	$ 13,318,571
Basis adjustment associated with fair value hedge	16,442	29,551
Current
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	12,053,564	13,308,517
30-59
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,009	2,484
60-89
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	349	1,294
90+
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,261	6,276
Investor loans secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	7,865,041	8,576,026
Investor loans secured by real estate | CRE non-owner-occupied
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	2,131,112	2,421,772
Investor loans secured by real estate | Multifamily
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	5,326,009	5,645,310
Investor loans secured by real estate | Construction and land
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	379,143	472,544
Investor loans secured by real estate | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	28,777	36,400
Investor loans secured by real estate | Current
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	7,865,041	8,575,194
Investor loans secured by real estate | Current | CRE non-owner-occupied
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	2,131,112	2,421,360
Investor loans secured by real estate | Current | Multifamily
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	5,326,009	5,645,310
Investor loans secured by real estate | Current | Construction and land
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	379,143	472,544
Investor loans secured by real estate | Current | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	28,777	35,980
Investor loans secured by real estate | 30-59
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 30-59 | CRE non-owner-occupied
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 30-59 | Multifamily
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 30-59 | Construction and land
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 30-59 | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 60-89
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 60-89 | CRE non-owner-occupied
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 60-89 | Multifamily
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 60-89 | Construction and land
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 60-89 | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 90+
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	832
Investor loans secured by real estate | 90+ | CRE non-owner-occupied
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	412
Investor loans secured by real estate | 90+ | Multifamily
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 90+ | Construction and land
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Investor loans secured by real estate | 90+ | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	420
Business loans secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	2,294,816	2,546,589
Business loans secured by real estate | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	43,978	50,741
Business loans secured by real estate | CRE owner-occupied
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,995,144	2,191,334
Business loans secured by real estate | Franchise real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	255,694	304,514
Business loans secured by real estate | Current
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	2,294,816	2,541,505
Business loans secured by real estate | Current | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	43,978	50,604
Business loans secured by real estate | Current | CRE owner-occupied
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,995,144	2,186,679
Business loans secured by real estate | Current | Franchise real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	255,694	304,222
Business loans secured by real estate | 30-59
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	429
Business loans secured by real estate | 30-59 | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	137
Business loans secured by real estate | 30-59 | CRE owner-occupied
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Business loans secured by real estate | 30-59 | Franchise real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	292
Business loans secured by real estate | 60-89
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Business loans secured by real estate | 60-89 | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Business loans secured by real estate | 60-89 | CRE owner-occupied
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Business loans secured by real estate | 60-89 | Franchise real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Business loans secured by real estate | 90+
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	4,655
Business loans secured by real estate | 90+ | SBA secured by real estate
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Business loans secured by real estate | 90+ | CRE owner-occupied
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	4,655
Business loans secured by real estate | 90+ | Franchise real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Commercial loans
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,707,783	2,121,255
Commercial loans | Commercial and industrial
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,486,340	1,790,608
Commercial loans | Franchise non-real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	213,357	319,721
Commercial loans | SBA non-real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	8,086	10,926
Commercial loans | Current
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,705,300	2,117,136
Commercial loans | Current | Commercial and industrial
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,483,926	1,788,855
Commercial loans | Current | Franchise non-real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	213,357	318,162
Commercial loans | Current | SBA non-real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	8,017	10,119
Commercial loans | 30-59
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	873	2,036
Commercial loans | 30-59 | Commercial and industrial
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	824	228
Commercial loans | 30-59 | Franchise non-real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	1,559
Commercial loans | 30-59 | SBA non-real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	49	249
Commercial loans | 60-89
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	349	1,294
Commercial loans | 60-89 | Commercial and industrial
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	349	1,294
Commercial loans | 60-89 | Franchise non-real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Commercial loans | 60-89 | SBA non-real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Commercial loans | 90+
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,261	789
Commercial loans | 90+ | Commercial and industrial
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,241	231
Commercial loans | 90+ | Franchise non-real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Commercial loans | 90+ | SBA non-real estate secured
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	20	558
Retail loans
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	188,543	74,701
Retail loans | Single family residential
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	186,739	72,752
Retail loans | Consumer loans
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,804	1,949
Retail loans | Current
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	188,407	74,682
Retail loans | Current | Single family residential
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	186,603	72,733
Retail loans | Current | Consumer loans
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	1,804	1,949
Retail loans | 30-59
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	136	19
Retail loans | 30-59 | Single family residential
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	136	19
Retail loans | 30-59 | Consumer loans
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Retail loans | 60-89
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Retail loans | 60-89 | Single family residential
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Retail loans | 60-89 | Consumer loans
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Retail loans | 90+
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Retail loans | 90+ | Single family residential
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	0	0
Retail loans | 90+ | Consumer loans
Financing Receivable, Past Due [Line Items]
Loans held for investment before basis adjustment	$ 0	$ 0