Fair Value of Financial Instruments (Schedule of Carrying Amounts and Estimated Fair Values of Financial Instruments) (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	$ 93,666	$ 64,519
Securities held to maturity	61,303	67,932
Accrued interest receivable	15,767	16,648
Bank-owned life insurance	105,083	104,441
Accrued interest payable	2,100	2,154
Carrying Amount | Quoted Prices in Active Markets for Identical Assets (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	93,666	64,519
Due from banks, interest-bearing	282,683	166,783
Accrued interest receivable	15,767	16,648
Bank-owned life insurance	105,083	104,441
Carrying Amount | Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Securities held to maturity	61,303	67,932
SBA loans held for sale	18,449	0
Deposits	5,044,988	4,931,355
Borrowings	402,185	300,671
Accrued interest payable	2,100	2,154
Carrying Amount | Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total loans, net of allowance	4,528,210	4,432,068
SBA Servicing Asset	4,682	5,383
Estimated Fair Value | Quoted Prices in Active Markets for Identical Assets (Level 1)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Cash and due from banks, noninterest-bearing	93,666	64,519
Due from banks, interest-bearing	282,683	166,783
Accrued interest receivable	15,767	16,648
Bank-owned life insurance	105,083	104,441
Estimated Fair Value | Significant Other Observable Inputs (Level 2)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Securities held to maturity	62,385	68,333
SBA loans held for sale	19,332	0
Deposits	5,045,800	4,930,751
Borrowings	393,542	295,399
Accrued interest payable	2,100	2,154
Estimated Fair Value | Significant Unobservable Inputs (Level 3)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total loans, net of allowance	4,428,870	4,407,610
SBA Servicing Asset	$ 4,906	$ 5,649