Goodwill and Other Intangible Assets Carrying Value of Goodwill Rollforward (Details) - USD ($)	12 Months Ended
	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014
Goodwill [Line Items]
Goodwill, Period Increase (Decrease)		$ 0
Goodwill, Beginning of Year	$ 152,082,000
Goodwill, Acquired During Period	0	0
Goodwill, Impairment Loss	(9,528,000)	0	$ 0
Goodwill, End of Year	142,554,000	152,082,000
Private Banking Segment [Member]
Goodwill [Line Items]
Goodwill, Beginning of Year	0
Goodwill, Acquired During Period	0
Goodwill, Impairment Loss	0
Goodwill, End of Year	0	0
Wealth Management and Trust Segment [Member]
Goodwill [Line Items]
Goodwill, Beginning of Year	44,305,000
Goodwill, Acquired During Period	0
Goodwill, Impairment Loss	(9,528,000)
Goodwill, End of Year	34,777,000	44,305,000
Investment Managers Segment [Member]
Goodwill [Line Items]
Goodwill, Beginning of Year	66,955,000
Goodwill, Acquired During Period	0
Goodwill, Impairment Loss	0
Goodwill, End of Year	66,955,000	66,955,000
Wealth Advisors Segment [Member]
Goodwill [Line Items]
Goodwill, Beginning of Year	40,822,000
Goodwill, Acquired During Period	0
Goodwill, Impairment Loss	0
Goodwill, End of Year	$ 40,822,000	$ 40,822,000