Fair Value Disclosures - Assets and Liabilities Measured at Fair Value on a Recurring Basis (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Assets measured at fair value on a recurring basis
Securities - available for sale	$ 242,802	$ 248,820
Securities - equity investments	6,040	5,437
Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	242,802	248,820
Loans held for sale	36,716	2,735
Fair Value, Measurements, Recurring | Interest rate swaps
Assets measured at fair value on a recurring basis
Derivative financial instruments (cash flow hedges)	16
Mutual fund
Assets measured at fair value on a recurring basis
Securities - equity investments	6,040	5,437
Mutual fund | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - equity investments	6,040	5,437
U.S. Government agency obligations
Assets measured at fair value on a recurring basis
Securities - available for sale	18,448	39,760
U.S. Government agency obligations | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	18,448	39,760
Mortgage-backed securities, residential
Assets measured at fair value on a recurring basis
Securities - available for sale	29,790	38,016
Mortgage-backed securities, residential | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	29,790	38,016
Asset-backed securities
Assets measured at fair value on a recurring basis
Securities - available for sale	7,091	7,959
Asset-backed securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	7,091	7,959
State and municipal
Assets measured at fair value on a recurring basis
Securities - available for sale	43,362	32,065
State and municipal | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	43,362	32,065
CLO securities
Assets measured at fair value on a recurring basis
Securities - available for sale	117,491	75,273
CLO securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	117,491	75,273
Corporate bonds
Assets measured at fair value on a recurring basis
Securities - available for sale	22,927	51,583
Corporate bonds | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	22,927	51,583
SBA pooled securities
Assets measured at fair value on a recurring basis
Securities - available for sale	3,693	4,164
SBA pooled securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	3,693	4,164
ICC Contingent consideration | Fair Value, Measurements, Recurring
Liabilities measured at fair value on a recurring basis
Fair value of consideration paid included contingent consideration	21,991	21,622
Level 1 | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Loans held for sale	0	0
Level 1 | Fair Value, Measurements, Recurring | Interest rate swaps
Assets measured at fair value on a recurring basis
Derivative financial instruments (cash flow hedges)	0
Level 1 | Mutual fund | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - equity investments	6,040	5,437
Level 1 | U.S. Government agency obligations | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 1 | Mortgage-backed securities, residential | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 1 | Asset-backed securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 1 | State and municipal | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 1 | CLO securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 1 | Corporate bonds | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 1 | SBA pooled securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 1 | ICC Contingent consideration | Fair Value, Measurements, Recurring
Liabilities measured at fair value on a recurring basis
Fair value of consideration paid included contingent consideration	0	0
Level 2 | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	242,802	248,820
Loans held for sale	36,716	2,735
Level 2 | Fair Value, Measurements, Recurring | Interest rate swaps
Assets measured at fair value on a recurring basis
Derivative financial instruments (cash flow hedges)	16
Level 2 | Mutual fund | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - equity investments	0	0
Level 2 | U.S. Government agency obligations | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	18,448	39,760
Level 2 | Mortgage-backed securities, residential | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	29,790	38,016
Level 2 | Asset-backed securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	7,091	7,959
Level 2 | State and municipal | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	43,362	32,065
Level 2 | CLO securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	117,491	75,273
Level 2 | Corporate bonds | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	22,927	51,583
Level 2 | SBA pooled securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	3,693	4,164
Level 2 | ICC Contingent consideration | Fair Value, Measurements, Recurring
Liabilities measured at fair value on a recurring basis
Fair value of consideration paid included contingent consideration	0	0
Level 3 | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Loans held for sale	0	0
Level 3 | Fair Value, Measurements, Recurring | Interest rate swaps
Assets measured at fair value on a recurring basis
Derivative financial instruments (cash flow hedges)	0
Level 3 | Mutual fund | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - equity investments	0	0
Level 3 | U.S. Government agency obligations | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 3 | Mortgage-backed securities, residential | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 3 | Asset-backed securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 3 | State and municipal | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 3 | CLO securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 3 | Corporate bonds | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 3 | SBA pooled securities | Fair Value, Measurements, Recurring
Assets measured at fair value on a recurring basis
Securities - available for sale	0	0
Level 3 | ICC Contingent consideration | Fair Value, Measurements, Recurring
Liabilities measured at fair value on a recurring basis
Fair value of consideration paid included contingent consideration	$ 21,991	$ 21,622