Business Segment Information - Operating Statements (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2020	Mar. 31, 2019	Dec. 31, 2019
Operating Income
Interest income	$ 40,942	$ 33,449
Total interest expense	2,362	2,407
Net interest income	38,580	31,042
Provision (credit) for credit losses on loans(1)	13,270	(1,061)
Net interest income after provision	25,310	32,103
Noninterest income	3,193	2,468
Noninterest expense	25,774	17,918
Income before income taxes	2,729	16,653
Income tax expense	868	4,507
Net income	1,861	12,146
Total assets	4,078,162	3,115,877	$ 4,109,463
Loans, net of deferred fees	2,553,911	1,848,318	2,533,844
Goodwill	167,371	83,753	$ 167,420
Business Combination, Acquisition Related Costs	2,424
Pre-tax acquisition costs	2,424
Banking
Operating Income
Interest income	38,065	30,496
Intersegment interest allocations	284	314
Total interest expense	2,362	2,407
Net interest income	35,987	28,403
Provision (credit) for credit losses on loans(1)	12,874	(892)
Net interest income after provision	23,113	29,295
Noninterest income	3,023	2,232
Noninterest expense	24,183	16,201
Intersegment expense allocations	129	121
Income before income taxes	2,082	15,447
Income tax expense	677	4,151
Net income	1,405	11,296
Total assets	4,009,344	3,053,116
Loans, net of deferred fees	2,499,837	1,800,064
Goodwill	154,327	70,709
Factoring
Operating Income
Interest income	2,877	2,953
Intersegment interest allocations	(284)	(314)
Net interest income	2,593	2,639
Provision (credit) for credit losses on loans(1)	396	(169)
Net interest income after provision	2,197	2,808
Noninterest income	170	236
Noninterest expense	1,591	1,717
Intersegment expense allocations	(129)	(121)
Income before income taxes	647	1,206
Income tax expense	191	356
Net income	456	850
Total assets	68,818	62,761
Loans, net of deferred fees	54,074	48,254
Goodwill	$ 13,044	$ 13,044