Goodwill and Other Intangible Assets Goodwill and Accumulated Impairment Charges (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013		Dec. 31, 2012
Goodwill [Line Items]
Goodwill, Gross	$ 194,722		$ 244,619
Goodwill, Impaired, Accumulated Impairment Loss	(84,542)		(134,439)
Goodwill	110,180		110,180
Private Banking Segment [Member]
Goodwill [Line Items]
Goodwill, Gross	36,684	[1]	86,581
Goodwill, Impaired, Accumulated Impairment Loss	(34,281)	[1]	(84,178)
Goodwill	2,403	[1]	2,403
Investment Managers Segment [Member]
Goodwill [Line Items]
Goodwill, Gross	117,216		117,216
Goodwill, Impaired, Accumulated Impairment Loss	(50,261)		(50,261)
Goodwill	66,955		66,955
Wealth Advisors Segment [Member]
Goodwill [Line Items]
Goodwill, Gross	40,822		40,822
Goodwill, Impaired, Accumulated Impairment Loss	0		0
Goodwill	$ 40,822		$ 40,822

[1] Private Banking goodwill and cumulative goodwill impairment related to the three Pacific Northwest offices was derecognized in 2013 due to the sale of those offices in May 2013.