Restructuring (Details) (USD $)	3 Months Ended				42 Months Ended
	Jun. 30, 2014	Mar. 31, 2014	Jun. 30, 2013	Mar. 31, 2013	Jun. 30, 2014	Dec. 31, 2013	Dec. 31, 2012
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Cost Incurred to Date					$ 14,000,000
Restructuring Reserve	0	0	1,903,000	2,879,000	0	33,000	3,623,000
Restructuring and Related Cost, Incurred Cost	0	0	0	0
Restructuring Reserve, Settled with Cash	0	(33,000)	(976,000)	(744,000)
Employee Severance [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve	0	0	1,805,000	2,781,000	0	33,000	3,517,000
Restructuring and Related Cost, Incurred Cost	0	0	0	0
Restructuring Reserve, Settled with Cash	0	(33,000)	(976,000)	(736,000)
Contract Termination [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve	0	0	98,000	98,000	0	0	98,000
Restructuring and Related Cost, Incurred Cost	0	0	0	0
Restructuring Reserve, Settled with Cash	0	0	0	0
Restructuring Related Professional Fees [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring Reserve	0	0	0	0	0	0	8,000
Restructuring and Related Cost, Incurred Cost	0	0	0	0
Restructuring Reserve, Settled with Cash	0	0	0	(8,000)
Private Banking Segment [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Cost Incurred to Date					9,500,000
Holding Company and Eliminations Segment [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Cost Incurred to Date					4,500,000
Senior Executive Restructuring Plan 2012 [Member]
Restructuring Cost and Reserve [Line Items]
Restructuring and Related Cost, Expected Cost					0
Restructuring and Related Cost, Cost Incurred to Date					$ 4,800,000