Fair Value of Financial Instruments - Schedule of Carrying Amounts and Estimated Fair Values of Financial Instruments (Details) - USD ($) $ in Thousands	Dec. 31, 2022	Dec. 31, 2021
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	$ 101,133	$ 128,228
Securities held to maturity	541,700	513,825
Total loans, net of allowance	6,574,178	6,002,926
Accrued interest receivable	29,710	25,896
Bank-owned life insurance	164,592	165,786
SBA servicing asset	392,400	414,200
Accrued interest payable	2,738	607
Carrying Amount | Level 1
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	101,133	128,228
Due from banks, interest-bearing	169,185	332,934
Accrued interest receivable	29,710	25,896
Bank-owned life insurance	164,592	165,786
Carrying Amount | Level 2
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Securities held to maturity	541,700	513,825
SBA and other loans held for sale	0	61,003
Deposits	9,227,529	9,124,629
Borrowings	287,507	67,386
Accrued interest payable	2,738	607
Carrying Amount | Level 3
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total loans, net of allowance	6,574,178	6,002,926
SBA servicing asset	4,004	5,472
Estimated Fair Value | Level 1
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	101,133	128,228
Due from banks, interest-bearing	169,185	332,934
Accrued interest receivable	29,710	25,896
Bank-owned life insurance	164,592	165,786
Estimated Fair Value | Level 2
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Securities held to maturity	432,528	511,699
SBA and other loans held for sale	0	62,004
Deposits	9,218,945	9,124,701
Borrowings	277,146	61,295
Accrued interest payable	2,738	607
Estimated Fair Value | Level 3
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total loans, net of allowance	6,240,870	5,990,235
SBA servicing asset	$ 4,721	$ 5,546