Portfolio Loans - Summary of Recorded Investment in Impaired Portfolio Loans by Category (Details) - Non-Covered Loans - USD ($) $ in Thousands	Dec. 31, 2021	Dec. 31, 2020
Financing Receivable, Past Due [Line Items]
Non-accrual	$ 23,449	$ 34,818
Restructured, accruing	2,859	3,559
Loans over 90 days past due and still accruing interest	1,716	130
Total Recorded Investment	28,024	38,507
Recorded Investment With No Allowance	9,751	18,246
Commercial and industrial
Financing Receivable, Past Due [Line Items]
Non-accrual	17,052	18,158
Restructured, accruing	2,783	3,482
Loans over 90 days past due and still accruing interest	1,703	130
Total Recorded Investment	21,538	21,770
Recorded Investment With No Allowance	5,685	8,316
Commercial - investor owned
Financing Receivable, Past Due [Line Items]
Non-accrual	1,575	9,579
Restructured, accruing	0	0
Loans over 90 days past due and still accruing interest	0	0
Total Recorded Investment	1,575	9,579
Recorded Investment With No Allowance	168	716
CRE - owner occupied
Financing Receivable, Past Due [Line Items]
Non-accrual	2,839	2,940
Restructured, accruing	0	0
Loans over 90 days past due and still accruing interest	0	0
Total Recorded Investment	2,839	2,940
Recorded Investment With No Allowance	2,550	6,024
Residential real estate
Financing Receivable, Past Due [Line Items]
Non-accrual	1,971	4,112
Restructured, accruing	76	77
Loans over 90 days past due and still accruing interest	1	0
Total Recorded Investment	2,048	4,189
Recorded Investment With No Allowance	1,348	0
Other
Financing Receivable, Past Due [Line Items]
Non-accrual	12	29
Restructured, accruing	0	0
Loans over 90 days past due and still accruing interest	12	0
Total Recorded Investment	24	29
Recorded Investment With No Allowance	$ 0	$ 3,190