Fair Value (Schedule of Carrying Amounts and Estimated Fair Values of Financial Instruments) (Details) - USD ($) $ in Thousands	Mar. 31, 2021	Dec. 31, 2020
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	$ 71,206	$ 93,724
Securities held to maturity	198,843	167,551
Total loans, net of allowance	4,558,205	4,678,927
Accrued interest receivable	18,652	20,272
Bank-owned life insurance	107,594	106,974
SBA Servicing Asset	412,500	395,400
Accrued interest payable	741	904
Carrying Amount | Quoted Prices in Active Markets for Identical Assets (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	71,206	93,724
Due from banks, interest-bearing	458,860	273,566
Accrued interest receivable	18,652	20,272
Bank-owned life insurance	107,594	106,974
Carrying Amount | Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Securities held to maturity	198,843	167,551
SBA loans held for sale	7,002	6,077
Deposits	6,733,487	6,273,596
Borrowings	61,342	61,829
Accrued interest payable	741	904
Carrying Amount | Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total loans, net of allowance	4,558,205	4,678,927
SBA Servicing Asset	5,925	5,788
Commitments to extend credit	0	0
Estimated Fair Value | Quoted Prices in Active Markets for Identical Assets (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	71,206	93,724
Due from banks, interest-bearing	458,860	273,566
Accrued interest receivable	18,652	20,272
Bank-owned life insurance	107,594	106,974
Estimated Fair Value | Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Securities held to maturity	195,424	170,734
SBA loans held for sale	7,905	7,465
Deposits	6,734,623	6,275,329
Borrowings	53,005	53,321
Accrued interest payable	741	904
Estimated Fair Value | Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total loans, net of allowance	4,537,472	4,661,197
SBA Servicing Asset	6,481	6,569
Commitments to extend credit	$ 8,086	$ 461