Loans - Loan Portfolio Aging (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Dec. 31, 2019
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	$ 7,480	$ 6,955
Current	2,901,862	2,913,026
Total Loans Receivable	2,909,342	2,919,981
Total Loans 90 Days or More Past Due and Accruing	0	416
Commercial and industrial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	0
Owner-occupied commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	0
Investor commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	0
Construction
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	0
Single tenant lease financing
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	0
Public finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	0
Healthcare finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	0
Small business lending
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	0
Residential mortgage
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	416
Home equity
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	0
Other consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans 90 Days or More Past Due and Accruing	0	0
30-59 Days Past Due
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	160	309
60-89 Days Past Due
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	56	4,883
90 Days or More Past Due
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	7,264	1,763
Commercial Portfolio Segment
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	2,386,342	2,286,517
Commercial Portfolio Segment | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	292	233
Current	81,395	96,187
Total Loans Receivable	81,687	96,420
Commercial Portfolio Segment | Owner-occupied commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	2,066	464
Current	84,831	86,262
Total Loans Receivable	86,897	86,726
Commercial Portfolio Segment | Investor commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Current	13,286	12,567
Total Loans Receivable	13,286	12,567
Commercial Portfolio Segment | Construction
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Current	77,591	60,274
Total Loans Receivable	77,591	60,274
Commercial Portfolio Segment | Single tenant lease financing
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	4,680	4,680
Current	975,612	991,199
Total Loans Receivable	980,292	995,879
Commercial Portfolio Segment | Public finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Current	647,107	687,094
Total Loans Receivable	647,107	687,094
Commercial Portfolio Segment | Healthcare finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Current	380,956	300,612
Total Loans Receivable	380,956	300,612
Commercial Portfolio Segment | Small business lending
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	54
Current	118,526	46,891
Total Loans Receivable	118,526	46,945
Commercial Portfolio Segment | 30-59 Days Past Due | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	80	15
Commercial Portfolio Segment | 30-59 Days Past Due | Owner-occupied commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 30-59 Days Past Due | Investor commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 30-59 Days Past Due | Construction
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 30-59 Days Past Due | Single tenant lease financing
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 30-59 Days Past Due | Public finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 30-59 Days Past Due | Healthcare finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 30-59 Days Past Due | Small business lending
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	54
Commercial Portfolio Segment | 60-89 Days Past Due | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	96
Commercial Portfolio Segment | 60-89 Days Past Due | Owner-occupied commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 60-89 Days Past Due | Investor commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 60-89 Days Past Due | Construction
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 60-89 Days Past Due | Single tenant lease financing
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	4,680
Commercial Portfolio Segment | 60-89 Days Past Due | Public finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 60-89 Days Past Due | Healthcare finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 60-89 Days Past Due | Small business lending
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0
Commercial Portfolio Segment | 90 Days or More Past Due | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	212	122
Commercial Portfolio Segment | 90 Days or More Past Due | Owner-occupied commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	2,066	464
Commercial Portfolio Segment | 90 Days or More Past Due | Investor commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 90 Days or More Past Due | Construction
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 90 Days or More Past Due | Single tenant lease financing
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	4,680	0
Commercial Portfolio Segment | 90 Days or More Past Due | Public finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 90 Days or More Past Due | Healthcare finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Commercial Portfolio Segment | 90 Days or More Past Due | Small business lending
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Consumer Portfolio
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	523,000	633,464
Consumer Portfolio | Residential mortgage
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	281	1,177
Current	208,447	312,672
Total Loans Receivable	208,728	313,849
Consumer Portfolio | Home equity
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Current	22,640	24,306
Total Loans Receivable	22,640	24,306
Consumer Portfolio | Other consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	161	347
Current	291,471	294,962
Total Loans Receivable	291,632	295,309
Consumer Portfolio | 30-59 Days Past Due | Residential mortgage
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Consumer Portfolio | 30-59 Days Past Due | Home equity
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Consumer Portfolio | 30-59 Days Past Due | Other consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	80	240
Consumer Portfolio | 60-89 Days Past Due | Residential mortgage
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Consumer Portfolio | 60-89 Days Past Due | Home equity
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Consumer Portfolio | 60-89 Days Past Due | Other consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	56	107
Consumer Portfolio | 90 Days or More Past Due | Residential mortgage
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	281	1,177
Consumer Portfolio | 90 Days or More Past Due | Home equity
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	0	0
Consumer Portfolio | 90 Days or More Past Due | Other consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Past Due	25	0
Nonaccrual
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	8,195	6,164
Nonaccrual | Commercial Portfolio Segment | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	299	226
Nonaccrual | Commercial Portfolio Segment | Owner-occupied commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	2,066	464
Nonaccrual | Commercial Portfolio Segment | Investor commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	0	0
Nonaccrual | Commercial Portfolio Segment | Construction
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	0	0
Nonaccrual | Commercial Portfolio Segment | Single tenant lease financing
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	4,680	4,680
Nonaccrual | Commercial Portfolio Segment | Public finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	0	0
Nonaccrual | Commercial Portfolio Segment | Healthcare finance
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	0	0
Nonaccrual | Commercial Portfolio Segment | Small business lending
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	0	0
Nonaccrual | Consumer Portfolio
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	1,150	794
Nonaccrual | Consumer Portfolio | Residential mortgage
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	1,042	761
Nonaccrual | Consumer Portfolio | Home equity
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	0	0
Nonaccrual | Consumer Portfolio | Other consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Total Loans Receivable	$ 108	$ 33