Reportable Segments (Details) - USD ($) $ in Thousands		3 Months Ended		6 Months Ended
		Jun. 30, 2018	Jun. 30, 2017	Jun. 30, 2018	Jun. 30, 2017	Dec. 31, 2017
Segment Reporting Information [Line Items]
Interest Income (Expense), Net		$ 57,545	$ 57,145	$ 114,928	$ 110,787
Total fees and other income		32,095	38,018	71,838	74,524
Revenues		89,640	95,163	186,766	185,311
Provision/ (credit) for loan losses		453	(6,114)	(1,342)	(6,295)
Noninterest Expense		64,384	67,821	135,241	136,601
Income before income taxes		24,803	33,456	52,867	55,005
Income tax expense		17,399	9,963	23,425	16,516
Net income from continuing operations		7,404	23,493	29,442	38,489
Net Income (Loss) Attributable to Noncontrolling Interest		968	1,150	2,018	2,116
Net income from discontinued operations		(2)	1,063	1,696	2,695
Net income attributable to the Company		6,434	23,406	29,120	39,068
Total assets		8,716,203	8,107,646	8,716,203	8,107,646	$ 8,311,744
Amortization of intangibles		749	1,426	1,499	2,852
Depreciation		2,561	1,980	4,663	3,980
Private Banking Segment [Member]
Segment Reporting Information [Line Items]
Interest Income (Expense), Net		58,447	57,783	116,578	112,039
Total fees and other income		2,825	2,634	5,300	4,462
Revenues		61,272	60,417	121,878	116,501
Provision/ (credit) for loan losses		453	(6,114)	(1,342)	(6,295)
Noninterest Expense		39,670	36,904	79,297	71,962
Income before income taxes		21,149	29,627	43,923	50,834
Income tax expense		3,981	9,209	8,594	15,478
Net income from continuing operations		17,168	20,418	35,329	35,356
Net income attributable to the Company		17,168	20,418	35,329	35,356
Total assets		8,637,774	7,951,911	8,637,774	7,951,911
Depreciation		2,031	1,343	3,615	2,714
Wealth Management and Trust Segment [Member]
Segment Reporting Information [Line Items]
Total fees and other income		11,293	11,274	23,567	22,195
Noninterest Expense		11,058	11,937	21,752	25,810
Income before income taxes		235	(663)	1,815	(3,615)
Income tax expense		34	(239)	509	(1,405)
Net income from continuing operations		201	(424)	1,306	(2,210)
Net income attributable to the Company		201	(424)	1,306	(2,210)
Total assets		73,202	74,842	73,202	74,842
Amortization of intangibles		701	727	1,402	1,454
Depreciation		334	341	655	678
Investment Managers Segment [Member]
Segment Reporting Information [Line Items]
Interest Income (Expense), Net	[1]	2	4	6	8
Total fees and other income	[1]	4,234	11,091	15,642	21,950
Revenues	[1]	4,236	11,095	15,648	21,958
Noninterest Expense	[1]	3,120	8,346	11,645	16,700
Income before income taxes	[1]	1,116	2,749	4,003	5,258
Income tax expense	[1]	249	894	920	1,738
Net income from continuing operations	[1]	867	1,855	3,083	3,520
Net Income (Loss) Attributable to Noncontrolling Interest	[1]	202	512	690	974
Net income attributable to the Company	[1]	665	1,343	2,393	2,546
Total assets	[1]	7,189	91,915	7,189	91,915
Amortization of intangibles	[1]	0	651	0	1,301
Depreciation	[1]	32	61	66	127
Wealth Advisors Segment [Member]
Segment Reporting Information [Line Items]
Interest Income (Expense), Net		77	29	125	46
Total fees and other income		13,717	12,980	27,256	25,823
Revenues		13,794	13,009	27,381	25,869
Noninterest Expense		9,227	8,943	19,763	18,386
Income before income taxes		4,567	4,066	7,618	7,483
Income tax expense		1,214	1,511	2,000	2,798
Net income from continuing operations		3,353	2,555	5,618	4,685
Net Income (Loss) Attributable to Noncontrolling Interest		766	638	1,328	1,142
Net income attributable to the Company		2,587	1,917	4,290	3,543
Total assets		76,175	75,247	76,175	75,247
Amortization of intangibles		48	48	97	97
Depreciation		164	235	327	461
Holding Company and Eliminations Segment [Member]
Segment Reporting Information [Line Items]
Interest Income (Expense), Net		(981)	(671)	(1,781)	(1,306)
Total fees and other income		26	39	73	94
Revenues		(955)	(632)	(1,708)	(1,212)
Noninterest Expense		1,309	1,691	2,784	3,743
Income before income taxes		(2,264)	(2,323)	(4,492)	(4,955)
Income tax expense	[2]	11,921	(1,412)	11,402	(2,093)
Net income from continuing operations		(14,185)	(911)	(15,894)	(2,862)
Net income from discontinued operations		(2)	1,063	1,696	2,695
Net income attributable to the Company		(14,187)	152	(14,198)	(167)
Total assets		$ (78,137)	$ (86,269)	$ (78,137)	$ (86,269)

[1] Results for the Investment Management segment for the three and six months ended June 30, 2017 include results for DGHM and Anchor. Results for the Investment Management segment for the three and six months ended June 30, 2018 include results for DGHM and results for Anchor through its sale date in April 2018. Assets for the Investment Management Segment at June 30, 2017 include assets of DGHM and Anchor. Assets for the Investment Management segment at June 30, 2018 include assets of DGHM.

[2] Income tax expense/ (benefit) for the three and six months ended June 30, 2018 include $12.7 million in additional expense related to the sale of Anchor in April 2018.