Business Segment Information - Operating Statements (Details) - USD ($) $ in Thousands	3 Months Ended				6 Months Ended
	Jun. 30, 2022	Mar. 31, 2022	Jun. 30, 2021	Mar. 31, 2021	Jun. 30, 2022	Jun. 30, 2021	Dec. 31, 2021
Operating Income
Interest income	$ 43,556		$ 36,632		$ 83,462	$ 73,393
Total interest expense	1,677		1,756		3,362	3,559
Net interest income	41,879		34,876		80,100	69,834
Provision for (recapture of) credit losses on loans	(181)		(493)		(748)	(2,005)
Net interest income after provision	42,060		35,369		80,848	71,839
Noninterest income	2,098		2,169		4,558	4,470
Noninterest expense	23,190		25,775		46,442	49,019
Income before income taxes	20,968		11,763		38,964	27,290
Income tax expense	6,147		2,950		11,277	7,273
Net income	14,821	$ 12,866	8,813	$ 11,204	27,687	20,017
Total assets	5,356,841		5,072,875		5,356,841	5,072,875	$ 5,499,409
Loans, net of deferred fees	3,082,452		2,824,796		3,082,452	2,824,796	3,087,326
Goodwill	167,631		167,631		167,631	167,631	167,631
Banking
Operating Income
Interest income	40,427		33,860		77,540	67,971
Intersegment interest allocations	321		202		558	413
Total interest expense	1,677		1,756		3,362	3,559
Net interest income	39,071		32,306		74,736	64,825
Provision for (recapture of) credit losses on loans	(328)		(486)		(867)	(1,949)
Net interest income after provision	39,399		32,792		75,603	66,774
Noninterest income	1,974		2,049		4,372	4,209
Noninterest expense	21,559		24,331		43,326	46,228
Intersegment expense allocations	128		127		242	233
Income before income taxes	19,942		10,637		36,891	24,988
Income tax expense	5,844		2,617		10,664	6,593
Net income	14,098		8,020		26,227	18,395
Total assets	5,280,953		5,003,894		5,280,953	5,003,894
Loans, net of deferred fees	3,019,076		2,777,685		3,019,076	2,777,685
Goodwill	154,587		154,587		154,587	154,587	154,587
Factoring
Operating Income
Interest income	3,129		2,772		5,922	5,422
Intersegment interest allocations	(321)		(202)		(558)	(413)
Net interest income	2,808		2,570		5,364	5,009
Provision for (recapture of) credit losses on loans	147		(7)		119	(56)
Net interest income after provision	2,661		2,577		5,245	5,065
Noninterest income	124		120		186	261
Noninterest expense	1,631		1,444		3,116	2,791
Intersegment expense allocations	(128)		(127)		(242)	(233)
Income before income taxes	1,026		1,126		2,073	2,302
Income tax expense	303		333		613	680
Net income	723		793		1,460	1,622
Total assets	75,888		68,981		75,888	68,981
Loans, net of deferred fees	63,376		47,111		63,376	47,111
Goodwill	$ 13,044		$ 13,044		$ 13,044	$ 13,044	$ 13,044