Business Segment Information - Operating Statements (Details) - USD ($)	3 Months Ended				6 Months Ended
	Jun. 30, 2024	Mar. 31, 2024	Jun. 30, 2023	Mar. 31, 2023	Jun. 30, 2024	Jun. 30, 2023	Dec. 31, 2023
Operating Income
Interest income	$ 59,077,000		$ 58,341,000		$ 116,628,000	$ 114,615,000
Total interest expense	19,622,000		12,048,000		37,080,000	19,064,000
Net interest income	39,455,000		46,293,000		79,548,000	95,551,000
Provision for (recapture of) credit losses on loans	471,000		260,000		655,000	292,000
Net interest income after provision	38,984,000		46,033,000		78,893,000	95,259,000
Noninterest income	2,276,000		2,074,000		4,323,000	4,840,000
Noninterest expense	28,188,000		24,991,000		55,724,000	50,392,000
Income before income taxes	13,072,000		23,116,000		27,492,000	49,707,000
Income tax expense	3,838,000		6,713,000		8,092,000	14,387,000
Net income	9,234,000	$ 10,166,000	16,403,000	$ 18,917,000	19,400,000	35,320,000
Total assets	5,263,024,000		5,311,837,000		5,263,024,000	5,311,837,000	$ 5,194,095,000
Loans, net of deferred fees	3,379,793,000		3,288,784,000		3,379,793,000	3,288,784,000	3,350,378,000
Goodwill	167,631,000		167,631,000		167,631,000	167,631,000	167,631,000
Banking
Operating Income
Interest income	56,163,000		54,494,000		110,876,000	106,767,000
Intersegment interest allocations	453,000		524,000		876,000	1,229,000
Total interest expense	19,622,000		12,048,000		37,080,000	19,064,000
Net interest income	36,994,000		42,970,000		74,672,000	88,932,000
Provision for (recapture of) credit losses on loans	85,000		409,000		370,000	553,000
Net interest income after provision	36,909,000		42,561,000		74,302,000	88,379,000
Noninterest income	2,089,000		2,017,000		4,048,000	4,699,000
Noninterest expense	26,541,000		23,329,000		52,630,000	47,057,000
Intersegment expense allocations	132,000		152,000		260,000	326,000
Income before income taxes	12,589,000		21,401,000		25,980,000	46,347,000
Income tax expense	3,695,000		6,206,000		7,645,000	13,394,000
Net income	8,894,000		15,195,000		18,335,000	32,953,000
Total assets	5,179,963,000		5,227,310,000		5,179,963,000	5,227,310,000
Loans, net of deferred fees	3,323,107,000		3,227,905,000		3,323,107,000	3,227,905,000
Goodwill	154,587,000		154,587,000		154,587,000	154,587,000	154,587,000
Factoring
Operating Income
Interest income	2,914,000		3,847,000		5,752,000	7,848,000
Intersegment interest allocations	(453,000)		(524,000)		(876,000)	(1,229,000)
Net interest income	2,461,000		3,323,000		4,876,000	6,619,000
Provision for (recapture of) credit losses on loans	386,000		(149,000)		285,000	(261,000)
Net interest income after provision	2,075,000		3,472,000		4,591,000	6,880,000
Noninterest income	187,000		57,000		275,000	141,000
Noninterest expense	1,647,000		1,662,000		3,094,000	3,335,000
Intersegment expense allocations	(132,000)		(152,000)		(260,000)	(326,000)
Income before income taxes	483,000		1,715,000		1,512,000	3,360,000
Income tax expense	143,000		507,000		447,000	993,000
Net income	340,000		1,208,000		1,065,000	2,367,000
Total assets	83,061,000		84,527,000		83,061,000	84,527,000
Loans, net of deferred fees	56,686,000		60,879,000		56,686,000	60,879,000
Goodwill	$ 13,044,000		$ 13,044,000		$ 13,044,000	$ 13,044,000	$ 13,044,000