Portfolio Loans - Schedule of activity on the allowance for loan losses (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2022	Sep. 30, 2021	Sep. 30, 2022	Sep. 30, 2021
Activity in the allowance for loan losses
ACL beginning balance	$ 88,757	$ 95,410	$ 87,887	$ 101,048
Provision for credit losses	2,364	(1,869)	3,764	(10,365)
Charged-off	(819)	(1,208)	(2,623)	(3,711)
Recoveries	420	469	1,694	1,652
ACL ending balance	90,722	92,802	90,722	92,802
Financial Asset Acquired with Credit Deterioration
Activity in the allowance for loan losses
ACL ending balance		4,178		4,178
Commercial
Activity in the allowance for loan losses
ACL beginning balance	23,359	24,356	23,855	23,866
Provision for credit losses	615	657	123	(1,428)
Charged-off	(381)	(764)	(589)	(2,026)
Recoveries	102	157	306	448
ACL ending balance	23,695	24,406	23,695	24,406
Commercial | Financial Asset Acquired with Credit Deterioration
Activity in the allowance for loan losses
ACL ending balance		3,546		3,546
Commercial real estate
Activity in the allowance for loan losses
ACL beginning balance	37,182	39,974	38,249	46,230
Provision for credit losses	598	(25)	408	(6,109)
Charged-off	0	(191)	(1,372)	(812)
Recoveries	19	73	514	186
ACL ending balance	37,799	39,831	37,799	39,831
Commercial real estate | Financial Asset Acquired with Credit Deterioration
Activity in the allowance for loan losses
ACL ending balance		336		336
Real estate construction
Activity in the allowance for loan losses
ACL beginning balance	5,669	7,599	5,102	8,193
Provision for credit losses	216	(1,503)	663	(2,082)
Charged-off	0	0	0	(209)
Recoveries	86	25	206	219
ACL ending balance	5,971	6,121	5,971	6,121
Real estate construction | Financial Asset Acquired with Credit Deterioration
Activity in the allowance for loan losses
ACL ending balance		0		0
Retail real estate
Activity in the allowance for loan losses
ACL beginning balance	17,984	20,505	17,589	21,992
Provision for credit losses	684	(1,155)	826	(3,028)
Charged-off	(220)	(155)	(253)	(315)
Recoveries	172	157	458	574
ACL ending balance	18,620	19,352	18,620	19,352
Retail real estate | Financial Asset Acquired with Credit Deterioration
Activity in the allowance for loan losses
ACL ending balance		129		129
Retail other
Activity in the allowance for loan losses
ACL beginning balance	4,563	2,976	3,092	767
Provision for credit losses	251	157	1,744	2,282
Charged-off	(218)	(98)	(409)	(349)
Recoveries	41	57	210	225
ACL ending balance	$ 4,637	3,092	$ 4,637	3,092
Retail other | Financial Asset Acquired with Credit Deterioration
Activity in the allowance for loan losses
ACL ending balance		$ 167		$ 167