Goodwill and Other Intangible Assets Carrying Value of Goodwill Rollforward (Details) - USD ($)		12 Months Ended
		Dec. 31, 2017		Dec. 31, 2016		Dec. 31, 2015
Goodwill [Line Items]
Goodwill, Period Increase (Decrease)						$ 0
Goodwill, Beginning of Year		$ 142,554,000		$ 152,082,000
Goodwill, Acquired During Period		0		0
Goodwill, Impairment Loss		(24,901,000)		(9,528,000)		0
Goodwill, Transfers		(42,055,000)
Goodwill, End of Year		75,598,000		142,554,000		152,082,000
Private Banking Segment [Member]
Goodwill [Line Items]
Goodwill, Beginning of Year		0		0
Goodwill, Impairment Loss		0		0
Goodwill, Transfers		0
Goodwill, End of Year		0		0		0
Wealth Management and Trust Segment [Member]
Goodwill [Line Items]
Goodwill, Beginning of Year		34,777,000		44,305,000
Goodwill, Impairment Loss		0		(9,528,000)
Goodwill, Transfers		0
Goodwill, End of Year		34,777,000		34,777,000		44,305,000
Investment Managers Segment [Member]
Goodwill [Line Items]
Goodwill, Beginning of Year		66,955,000	[1]	66,955,000
Goodwill, Impairment Loss		(24,901,000)	[1]	0
Goodwill, Written off Related to Sale of Business Unit	[1]	42,054,000
Goodwill, End of Year		0	[1],[2]	66,955,000	[1]	66,955,000
Wealth Advisors Segment [Member]
Goodwill [Line Items]
Goodwill, Beginning of Year		40,822,000	[3]	40,822,000
Goodwill, Impairment Loss		0	[3]	0
Goodwill, Transfers	[3]	(1,000)
Goodwill, End of Year		$ 40,821,000	[3],[4]	$ 40,822,000	[3]	$ 40,822,000

[1] Remaining goodwill of Anchor is classified as held for sale as of December 31, 2017.

[2] Remaining goodwill of Anchor is classified as held for sale as of December 31, 2017.

[3] Adjusted for rounding.

[4] Adjusted for rounding.