Loans and Leases Held for Investment and Credit Quality - Summary of Total Loans and Leases Held for Investment and Aging Analysis of Portfolio Segments (Details) - USD ($) $ in Thousands	Mar. 31, 2022	Dec. 31, 2021
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	$ 5,142,004	$ 4,881,665
Loans Accounted for Under the Fair Value Option	600,571	645,201
Total Loans and Leases	5,742,575	5,526,866
Net deferred fees	(4,334)	(5,604)
Loans and Leases, Net	5,738,241	5,521,262
Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	5,099,113	4,829,994
30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	16,540	26,440
90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	26,351	25,231
Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	42,891	51,671
Small Business Banking
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	3,561,002	3,368,221
Specialty Lending
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	1,446,712	1,245,069
Paycheck Protection Program
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	134,290	268,375
Commercial & Industrial
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	2,357,576	2,268,148
Loans Accounted for Under the Fair Value Option	290,655	313,331
Total Loans and Leases	2,648,231	2,581,479
Commercial & Industrial | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	2,339,340	2,246,175
Commercial & Industrial | 30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	6,531	13,239
Commercial & Industrial | 90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	11,705	8,734
Commercial & Industrial | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	18,236	21,973
Commercial & Industrial | Small Business Banking
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	1,198,061	1,124,406
Loans Accounted for Under the Fair Value Option	230,009	248,806
Total Loans and Leases	1,428,070	1,373,212
Commercial & Industrial | Small Business Banking | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	1,181,570	1,103,915
Commercial & Industrial | Small Business Banking | 30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	6,200	13,171
Commercial & Industrial | Small Business Banking | 90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	10,291	7,320
Commercial & Industrial | Small Business Banking | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	16,491	20,491
Commercial & Industrial | Specialty Lending
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	1,025,225	875,367
Loans Accounted for Under the Fair Value Option	60,646	64,525
Total Loans and Leases	1,085,871	939,892
Commercial & Industrial | Specialty Lending | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	1,024,894	875,367
Commercial & Industrial | Specialty Lending | 30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	331
Commercial & Industrial | Specialty Lending | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	331
Commercial & Industrial | Paycheck Protection Program
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	134,290	268,375
Total Loans and Leases	134,290	268,375
Commercial & Industrial | Paycheck Protection Program | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	132,876	266,893
Commercial & Industrial | Paycheck Protection Program | 30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due		68
Commercial & Industrial | Paycheck Protection Program | 90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	1,414	1,414
Commercial & Industrial | Paycheck Protection Program | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	1,414	1,482
Construction & Development
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	393,025	359,166
Total Loans and Leases	393,025	359,166
Construction & Development | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	388,989	357,800
Construction & Development | 30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	2,670
Construction & Development | 90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	1,366	1,366
Construction & Development | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	4,036	1,366
Construction & Development | Small Business Banking
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	313,031	277,152
Total Loans and Leases	313,031	277,152
Construction & Development | Small Business Banking | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	308,995	275,786
Construction & Development | Small Business Banking | 30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	2,670
Construction & Development | Small Business Banking | 90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	1,366	1,366
Construction & Development | Small Business Banking | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	4,036	1,366
Construction & Development | Specialty Lending
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	79,994	82,014
Total Loans and Leases	79,994	82,014
Construction & Development | Specialty Lending | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	79,994	82,014
Commercial Real Estate
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	2,020,156	1,882,016
Loans Accounted for Under the Fair Value Option	252,703	270,337
Total Loans and Leases	2,272,859	2,152,353
Commercial Real Estate | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	2,001,772	1,863,138
Commercial Real Estate | 30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	7,159	5,802
Commercial Real Estate | 90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	11,225	13,076
Commercial Real Estate | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	18,384	18,878
Commercial Real Estate | Small Business Banking
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	1,678,663	1,594,328
Loans Accounted for Under the Fair Value Option	235,524	250,856
Total Loans and Leases	1,914,187	1,845,184
Commercial Real Estate | Small Business Banking | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	1,661,997	1,577,765
Commercial Real Estate | Small Business Banking | 30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	7,159	5,802
Commercial Real Estate | Small Business Banking | 90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	9,507	10,761
Commercial Real Estate | Small Business Banking | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	16,666	16,563
Commercial Real Estate | Specialty Lending
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	341,493	287,688
Loans Accounted for Under the Fair Value Option	17,179	19,481
Total Loans and Leases	358,672	307,169
Commercial Real Estate | Specialty Lending | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	339,775	285,373
Commercial Real Estate | Specialty Lending | 90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	1,718	2,315
Commercial Real Estate | Specialty Lending | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	1,718	2,315
Commercial Land
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	371,247	372,335
Loans Accounted for Under the Fair Value Option	57,213	61,533
Total Loans and Leases	428,460	433,868
Commercial Land | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	369,012	362,881
Commercial Land | 30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	180	7,399
Commercial Land | 90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	2,055	2,055
Commercial Land | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	2,235	9,454
Commercial Land | Small Business Banking
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Carried at Amortized Cost	371,247	372,335
Loans Accounted for Under the Fair Value Option	57,213	61,533
Total Loans and Leases	428,460	433,868
Commercial Land | Small Business Banking | Current or Less Than 30 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	369,012	362,881
Commercial Land | Small Business Banking | 30-89 Days Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	180	7,399
Commercial Land | Small Business Banking | 90 Days or More Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	2,055	2,055
Commercial Land | Small Business Banking | Total Past Due
Financing Receivable, Recorded Investment, Past Due [Line Items]
Total Past Due	$ 2,235	$ 9,454