Fair Value Disclosures - Fair Value of Assets Measured on Non-recurring Basis (Details) - Fair Value, Measurements, Nonrecurring - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	$ 43,566	$ 19,268
Collateral dependent loans | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	5,302
Collateral dependent loans | Construction, land development, land
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	637
Collateral dependent loans | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	5
Collateral dependent loans | Commercial
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	3,584
Collateral dependent loans | Factored receivables
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	33,803
Collateral dependent loans | Consumer
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	46
Other real estate owned | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		388
Other real estate owned | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	189	89
Impaired loans | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		534
Impaired loans | Construction, land development, land
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		664
Impaired loans | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		2
Impaired loans | Commercial
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		4,754
Impaired loans | Factored receivables
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		12,762
Impaired loans | Consumer
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		8
Impaired loans | PCI
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		67
Level 1
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0	0
Level 1 | Collateral dependent loans | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 1 | Collateral dependent loans | Construction, land development, land
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 1 | Collateral dependent loans | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 1 | Collateral dependent loans | Commercial
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 1 | Collateral dependent loans | Factored receivables
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 1 | Collateral dependent loans | Consumer
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 1 | Other real estate owned | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 1 | Other real estate owned | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0	0
Level 1 | Impaired loans | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 1 | Impaired loans | Construction, land development, land
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 1 | Impaired loans | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 1 | Impaired loans | Commercial
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 1 | Impaired loans | Factored receivables
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 1 | Impaired loans | Consumer
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 1 | Impaired loans | PCI
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 2
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0	0
Level 2 | Collateral dependent loans | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 2 | Collateral dependent loans | Construction, land development, land
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 2 | Collateral dependent loans | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 2 | Collateral dependent loans | Commercial
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 2 | Collateral dependent loans | Factored receivables
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 2 | Collateral dependent loans | Consumer
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0
Level 2 | Other real estate owned | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 2 | Other real estate owned | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	0	0
Level 2 | Impaired loans | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 2 | Impaired loans | Construction, land development, land
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 2 | Impaired loans | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 2 | Impaired loans | Commercial
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 2 | Impaired loans | Factored receivables
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 2 | Impaired loans | Consumer
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 2 | Impaired loans | PCI
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		0
Level 3
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	43,566	19,268
Level 3 | Collateral dependent loans | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	5,302
Level 3 | Collateral dependent loans | Construction, land development, land
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	637
Level 3 | Collateral dependent loans | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	5
Level 3 | Collateral dependent loans | Commercial
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	3,584
Level 3 | Collateral dependent loans | Factored receivables
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	33,803
Level 3 | Collateral dependent loans | Consumer
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	46
Level 3 | Other real estate owned | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		388
Level 3 | Other real estate owned | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring	$ 189	89
Level 3 | Impaired loans | Commercial real estate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		534
Level 3 | Impaired loans | Construction, land development, land
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		664
Level 3 | Impaired loans | 1-4 family residential
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		2
Level 3 | Impaired loans | Commercial
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		4,754
Level 3 | Impaired loans | Factored receivables
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		12,762
Level 3 | Impaired loans | Consumer
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		8
Level 3 | Impaired loans | PCI
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure, nonrecurring		$ 67