Restructuring (Details) (USD $)	12 Months Ended			36 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2013	Dec. 31, 2010
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve	$ 33,000	$ 3,623,000	$ 3,099,000	$ 33,000	$ 0
Restructuring and Related Cost, Incurred Cost	0	5,911,000	8,055,000
Restructuring Reserve, Settled with Cash	(3,489,000)	(5,387,000)	(4,956,000)
Restructuring Reserve, Accrual Adjustment	(101,000)
Restructuring and Related Cost, Cost Incurred to Date				14,000,000
Employee Severance [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve	33,000	3,517,000	2,658,000	33,000	0
Restructuring and Related Cost, Incurred Cost	0	4,798,000	3,947,000
Restructuring Reserve, Settled with Cash	(3,481,000)	(3,939,000)	(1,289,000)
Restructuring Reserve, Accrual Adjustment	(3,000)
Restructuring and Related Cost, Expected Cost	0
Contract Termination [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve	0	98,000	211,000	0	0
Restructuring and Related Cost, Incurred Cost	0	705,000	871,000
Restructuring Reserve, Settled with Cash	0	(818,000)	(660,000)
Restructuring Reserve, Accrual Adjustment	(98,000)
Restructuring Related Professional Fees [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve	0	8,000	230,000	0	0
Restructuring and Related Cost, Incurred Cost	0	280,000	2,539,000
Restructuring Reserve, Settled with Cash	(8,000)	(502,000)	(2,309,000)
Other Expense [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve	0	0	0	0	0
Restructuring and Related Cost, Incurred Cost	0	128,000	698,000
Restructuring Reserve, Settled with Cash	0	(128,000)	(698,000)
Private Banking Segment [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Cost Incurred to Date				9,500,000
Holding Company and Eliminations Segment [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Cost Incurred to Date				$ 4,500,000