Reportable Segments (Details) - USD ($) $ in Thousands		3 Months Ended		6 Months Ended
		Jun. 30, 2017	Jun. 30, 2016	Jun. 30, 2017	Jun. 30, 2016	Dec. 31, 2016
Segment Reporting Information [Line Items]
Interest Income (Expense), Net		$ 57,145	$ 49,169	$ 110,787	$ 99,048
Noninterest Income		38,018	36,795	74,524	74,817
Revenues		95,163	85,964	185,311	173,865
Provision/ (credit) for loan losses		(6,114)	(2,535)	(6,295)	(5,668)
Noninterest Expense		67,821	64,731	136,601	131,440
Income before income taxes		33,456	23,768	55,005	48,093
Income tax expense		9,963	7,626	16,516	15,064
Net income from continuing operations		23,493	16,142	38,489	33,029
Net income attributable to noncontrolling interests		1,150	989	2,116	1,900
Net income from discontinued operations		1,063	1,245	2,695	3,310
Net income attributable to the Company		23,406	16,398	39,068	34,439
Total assets		8,107,646	7,579,601	8,107,646	7,579,601	$ 7,970,474
Amortization of intangibles		1,426	1,586	2,852	3,172
Depreciation		1,980	1,698	3,980	3,374
Private Banking Segment [Member]
Segment Reporting Information [Line Items]
Interest Income (Expense), Net		57,783	49,713	112,039	100,133
Noninterest Income		2,634	2,227	4,462	5,605
Revenues		60,417	51,940	116,501	105,738
Provision/ (credit) for loan losses		(6,114)	(2,535)	(6,295)	(5,668)
Noninterest Expense		36,904	32,093	71,962	63,368
Income before income taxes		29,627	22,382	50,834	48,038
Income tax expense		9,209	7,038	15,478	15,412
Net income from continuing operations		20,418	15,344	35,356	32,626
Net income attributable to the Company		20,418	15,344	35,356	32,626
Total assets		7,951,911	7,417,465	7,951,911	7,417,465
Depreciation		1,343	1,125	2,714	2,271
Wealth Management and Trust Segment [Member]
Segment Reporting Information [Line Items]
Noninterest Income		11,274	11,300	22,195	22,356
Noninterest Expense	[1]	11,937	13,738	25,810	29,590
Income before income taxes		(663)	(2,438)	(3,615)	(7,234)
Income tax expense		(239)	(970)	(1,405)	(2,909)
Net income from continuing operations		(424)	(1,468)	(2,210)	(4,325)
Net income attributable to the Company		(424)	(1,468)	(2,210)	(4,325)
Total assets		74,842	86,397	74,842	86,397
Amortization of intangibles		727	745	1,454	1,490
Depreciation		341	269	678	500
Investment Managers Segment [Member]
Segment Reporting Information [Line Items]
Interest Income (Expense), Net		4	4	8	8
Noninterest Income		11,091	10,646	21,950	21,305
Revenues		11,095	10,650	21,958	21,313
Noninterest Expense		8,346	7,895	16,700	15,919
Income before income taxes		2,749	2,755	5,258	5,394
Income tax expense		894	898	1,738	1,777
Net income from continuing operations		1,855	1,857	3,520	3,617
Net income attributable to noncontrolling interests		512	469	974	946
Net income attributable to the Company		1,343	1,388	2,546	2,671
Total assets		91,915	93,975	91,915	93,975
Amortization of intangibles		651	651	1,301	1,301
Depreciation		61	74	127	147
Wealth Advisors Segment [Member]
Segment Reporting Information [Line Items]
Interest Income (Expense), Net		29	4	46	7
Noninterest Income		12,980	12,579	25,823	25,321
Revenues		13,009	12,583	25,869	25,328
Noninterest Expense		8,943	9,171	18,386	18,865
Income before income taxes		4,066	3,412	7,483	6,463
Income tax expense		1,511	1,266	2,798	2,414
Net income from continuing operations		2,555	2,146	4,685	4,049
Net income attributable to noncontrolling interests		638	520	1,142	954
Net income attributable to the Company		1,917	1,626	3,543	3,095
Total assets		75,247	76,370	75,247	76,370
Amortization of intangibles		48	190	97	381
Depreciation		235	220	461	435
Holding Company and Eliminations Segment [Member]
Segment Reporting Information [Line Items]
Interest Income (Expense), Net		(671)	(552)	(1,306)	(1,100)
Noninterest Income		39	43	94	230
Revenues		(632)	(509)	(1,212)	(870)
Noninterest Expense		1,691	1,834	3,743	3,698
Income before income taxes		(2,323)	(2,343)	(4,955)	(4,568)
Income tax expense		(1,412)	(606)	(2,093)	(1,630)
Net income from continuing operations		(911)	(1,737)	(2,862)	(2,938)
Net income from discontinued operations		1,063	1,245	2,695	3,310
Net income attributable to the Company		152	(492)	(167)	372
Total assets		(86,269)	(94,606)	(86,269)	(94,606)
Depreciation		$ 0	$ 10	$ 0	$ 21

[1] Operating expense related to the Wealth Management and Trust segment includes no restructuring expense for the three and six months ended June 30, 2017, respectively, and $0.9 million and $2.0 million of restructuring expenses for the three months and six months ended June 30, 2016, respectively.