Fair Value (Schedule of Carrying Amounts and Estimated Fair Values of Financial Instruments) (Details) - USD ($) $ in Thousands	Jun. 30, 2021	Dec. 31, 2020
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	$ 83,851	$ 93,724
Securities held to maturity	291,728	167,551
Total loans, net of allowance	4,717,042	4,678,927
Accrued interest receivable	20,357	20,272
Bank-owned life insurance	108,209	106,974
SBA Servicing Asset	426,900	395,400
Accrued interest payable	710	904
Carrying Amount | Quoted Prices in Active Markets for Identical Assets (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	83,851	93,724
Due from banks, interest-bearing	391,375	273,566
Accrued interest receivable	20,357	20,272
Bank-owned life insurance	108,209	106,974
Carrying Amount | Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Securities held to maturity	291,728	167,551
SBA loans held for sale	5,480	6,077
Deposits	7,171,358	6,273,596
Borrowings	61,252	61,829
Accrued interest payable	710	904
Carrying Amount | Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total loans, net of allowance	4,717,042	4,678,927
SBA Servicing Asset	6,089	5,788
Commitments to extend credit	0	0
Estimated Fair Value | Quoted Prices in Active Markets for Identical Assets (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	83,851	93,724
Due from banks, interest-bearing	391,375	273,566
Accrued interest receivable	20,357	20,272
Bank-owned life insurance	108,209	106,974
Estimated Fair Value | Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Securities held to maturity	292,774	170,734
SBA loans held for sale	6,297	7,465
Deposits	7,172,244	6,275,329
Borrowings	53,962	53,321
Accrued interest payable	710	904
Estimated Fair Value | Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total loans, net of allowance	4,704,356	4,661,197
SBA Servicing Asset	7,066	6,569
Commitments to extend credit	$ 10,025	$ 461