Loans and Leases Held for Investment and Credit Quality - Nonaccrual Loans and Leases Held for Investment (Details) - USD ($) $ in Thousands	Mar. 31, 2022	Dec. 31, 2021
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	$ 52,303	$ 42,533
Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	32,829	26,545
Unguaranteed Balance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	19,474	15,988
Unguaranteed Exposure with No ACL
Financing Receivable, Recorded Investment, Past Due [Line Items]
Unguaranteed exposure with no allowance	11,112	6,977
Commercial & Industrial
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	17,306	18,393
Commercial & Industrial | Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	14,053	15,463
Commercial & Industrial | Unguaranteed Balance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	3,253	2,930
Commercial & Industrial | Unguaranteed Exposure with No ACL
Financing Receivable, Recorded Investment, Past Due [Line Items]
Unguaranteed exposure with no allowance	407
Commercial & Industrial | Small Business Banking
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	15,892	16,911
Commercial & Industrial | Small Business Banking | Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	12,639	13,981
Commercial & Industrial | Small Business Banking | Unguaranteed Balance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	3,253	2,930
Commercial & Industrial | Small Business Banking | Unguaranteed Exposure with No ACL
Financing Receivable, Recorded Investment, Past Due [Line Items]
Unguaranteed exposure with no allowance	407
Commercial & Industrial | Payroll Protection Program
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	1,414	1,482
Commercial & Industrial | Payroll Protection Program | Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	1,414	1,482
Construction & Development
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	4,037	3,884
Construction & Development | Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	1,201	1,201
Construction & Development | Unguaranteed Balance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	2,836	2,683
Construction & Development | Unguaranteed Exposure with No ACL
Financing Receivable, Recorded Investment, Past Due [Line Items]
Unguaranteed exposure with no allowance	2,344
Construction & Development | Small Business Banking
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	4,037	3,884
Construction & Development | Small Business Banking | Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	1,201	1,201
Construction & Development | Small Business Banking | Unguaranteed Balance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	2,836	2,683
Construction & Development | Small Business Banking | Unguaranteed Exposure with No ACL
Financing Receivable, Recorded Investment, Past Due [Line Items]
Unguaranteed exposure with no allowance	2,344
Commercial Real Estate
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	21,848	14,725
Commercial Real Estate | Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	10,876	5,733
Commercial Real Estate | Unguaranteed Balance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	10,972	8,992
Commercial Real Estate | Unguaranteed Exposure with No ACL
Financing Receivable, Recorded Investment, Past Due [Line Items]
Unguaranteed exposure with no allowance	7,534	6,977
Commercial Real Estate | Small Business Banking
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	20,130	12,410
Commercial Real Estate | Small Business Banking | Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	10,876	5,226
Commercial Real Estate | Small Business Banking | Unguaranteed Balance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	9,254	7,184
Commercial Real Estate | Small Business Banking | Unguaranteed Exposure with No ACL
Financing Receivable, Recorded Investment, Past Due [Line Items]
Unguaranteed exposure with no allowance	5,816	5,169
Commercial Real Estate | Specialty Lending
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	1,718	2,315
Commercial Real Estate | Specialty Lending | Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance		507
Commercial Real Estate | Specialty Lending | Unguaranteed Balance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	1,718	1,808
Commercial Real Estate | Specialty Lending | Unguaranteed Exposure with No ACL
Financing Receivable, Recorded Investment, Past Due [Line Items]
Unguaranteed exposure with no allowance	1,718	1,808
Commercial Land
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	9,112	5,531
Commercial Land | Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	6,699	4,148
Commercial Land | Unguaranteed Balance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	2,413	1,383
Commercial Land | Unguaranteed Exposure with No ACL
Financing Receivable, Recorded Investment, Past Due [Line Items]
Unguaranteed exposure with no allowance	827
Commercial Land | Small Business Banking
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	9,112	5,531
Commercial Land | Small Business Banking | Loans Insured or Guaranteed by US Government Authorities
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	6,699	4,148
Commercial Land | Small Business Banking | Unguaranteed Balance
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual loan and lease balance	2,413	$ 1,383
Commercial Land | Small Business Banking | Unguaranteed Exposure with No ACL
Financing Receivable, Recorded Investment, Past Due [Line Items]
Unguaranteed exposure with no allowance	$ 827