Reportable Segments Segments Text Disclosures (Details) $ in Thousands		3 Months Ended																12 Months Ended
		Dec. 31, 2017 USD ($)	[1]	Sep. 30, 2017 USD ($)	[1]	Jun. 30, 2017 USD ($)	[1]	Mar. 31, 2017 USD ($)	[1]	Dec. 31, 2016 USD ($)	[1]	Sep. 30, 2016 USD ($)	[1]	Jun. 30, 2016 USD ($)	[1]	Mar. 31, 2016 USD ($)	[1]	Dec. 31, 2017 USD ($) segments		Dec. 31, 2016 USD ($)		Dec. 31, 2015 USD ($)
Segment Reporting Information [Line Items]
Number of Reportable Segments | segments																		4
Restructuring expense																		$ 0		$ 2,017		$ 3,724
Impairment of goodwill																		24,901		9,528		0
Gain/ (loss) on sale of affiliates or offices																		(1,264)		2,862		0
Income from Discontinued Operations, Net of Tax, Including Portion Attributable to Noncontrolling Interest		$ 989		$ 1,186		$ 1,063		$ 1,632		$ 1,184		$ 1,047		$ 1,245		$ 2,065		4,870	[2]	5,541	[2]	6,411	[2]
Wealth Management and Trust Segment [Member]
Segment Reporting Information [Line Items]
Restructuring expense																				2,017		3,724
Impairment of goodwill																		0		9,528
Investment Managers Segment [Member]
Segment Reporting Information [Line Items]
Impairment of goodwill																		24,901	[3]	0
Holding Company and Eliminations Segment [Member]
Segment Reporting Information [Line Items]
Gain/ (loss) on sale of affiliates or offices																		1,300
Income from Discontinued Operations, Net of Tax, Including Portion Attributable to Noncontrolling Interest	[2]																	$ 4,870		$ 5,541		$ 6,411

[1] Due to rounding, the sum of the four quarters may not add to the year to date total.

[2] The Holding Company and Eliminations calculation of Net Income attributable to the Company includes net income from Discontinued Operations for the years ended December 31, 2017, 2016 and 2015 of $4.9 million, $5.5 million, and $6.4 million, respectively

[3] Remaining goodwill of Anchor is classified as held for sale as of December 31, 2017.