Business Segment Information - Operating Statements (Details) - USD ($)	3 Months Ended
	Mar. 31, 2024	Mar. 31, 2023	Dec. 31, 2023
Operating Income
Interest income	$ 57,551,000	$ 56,274,000
Total interest expense	17,458,000	7,016,000
Net interest income	40,093,000	49,258,000
Provision for (recapture of) credit losses on loans	184,000	32,000
Net interest income after provision	39,909,000	49,226,000
Noninterest income	2,047,000	2,766,000
Noninterest expense	27,536,000	25,401,000
Income before income taxes	14,420,000	26,591,000
Income tax expense	4,254,000	7,674,000
Net income	10,166,000	18,917,000
Total assets	5,256,074,000	5,536,540,000	$ 5,194,095,000
Loans, net of deferred fees	3,336,102,000	3,261,915,000	3,350,378,000
Goodwill	167,631,000	167,631,000	167,631,000
Banking
Operating Income
Interest income	54,713,000	52,273,000
Intersegment interest allocations	423,000	705,000
Total interest expense	17,458,000	7,016,000
Net interest income	37,678,000	45,962,000
Provision for (recapture of) credit losses on loans	285,000	144,000
Net interest income after provision	37,393,000	45,818,000
Noninterest income	1,959,000	2,682,000
Noninterest expense	26,089,000	23,728,000
Intersegment expense allocations	128,000	174,000
Income before income taxes	13,391,000	24,946,000
Income tax expense	3,950,000	7,188,000
Net income	9,441,000	17,758,000
Total assets	5,172,553,000	5,453,352,000
Loans, net of deferred fees	3,280,404,000	3,192,491,000
Goodwill	154,587,000	154,587,000	154,587,000
Factoring
Operating Income
Interest income	2,838,000	4,001,000
Intersegment interest allocations	(423,000)	(705,000)
Net interest income	2,415,000	3,296,000
Provision for (recapture of) credit losses on loans	(101,000)	(112,000)
Net interest income after provision	2,516,000	3,408,000
Noninterest income	88,000	84,000
Noninterest expense	1,447,000	1,673,000
Intersegment expense allocations	(128,000)	(174,000)
Income before income taxes	1,029,000	1,645,000
Income tax expense	304,000	486,000
Net income	725,000	1,159,000
Total assets	83,521,000	83,188,000
Loans, net of deferred fees	55,698,000	69,424,000
Goodwill	$ 13,044,000	$ 13,044,000	$ 13,044,000