Restructuring (Details) - USD ($) $ in Thousands		12 Months Ended
		Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013	Dec. 31, 2012
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve		$ 3,305	$ 739	$ 33	$ 3,623
Restructuring and Related Cost, Incurred Cost		3,724	739
Restructuring Reserve, Settled with Cash		(1,158)	(33)	(3,489)
Restructuring Reserve, Accrual Adjustment				(101)
Restructuring and Related Cost, Cost Incurred to Date		18,400
Employee Severance [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve	[1]	3,305	739	33	3,517
Restructuring and Related Cost, Incurred Cost	[1]	3,434	739
Restructuring Reserve, Settled with Cash	[1]	(868)	(33)	(3,481)
Restructuring Reserve, Accrual Adjustment	[1]			(3)
Contract Termination [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve		0	0	0	98
Restructuring and Related Cost, Incurred Cost		0	0
Restructuring Reserve, Settled with Cash		0	0	0
Restructuring Reserve, Accrual Adjustment				(98)
Restructuring Related Professional Fees [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve		0	0	0	8
Restructuring and Related Cost, Incurred Cost		0	0
Restructuring Reserve, Settled with Cash		0	0	(8)
Restructuring Reserve, Accrual Adjustment				0
Other Expense [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve		0	0	0	0
Restructuring and Related Cost, Incurred Cost		290	0
Restructuring Reserve, Settled with Cash		(290)	0	0
Restructuring Reserve, Accrual Adjustment				$ 0
Private Banking Segment [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Cost Incurred to Date		9,500
Wealth Management and Trust Segment [Member] [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Cost Incurred to Date		4,400
Holding Company and Eliminations Segment [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Cost Incurred to Date		4,500
Senior Executive Restructuring Plan 2012 [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Expected Cost		0
Senior Executive Restructuring Plan 2012 [Member] | Employee Severance [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Incurred Cost					$ 4,800
Banyan Acquisition and WMT Management Restructuring Plan [Member] | Wealth Management and Trust Segment [Member] [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Incurred Cost		$ 3,700	$ 700

[1] In addition to salary costs, severance charges may include costs related to acceleration of stock awards, outplacement services, and medical benefits.