Reportable Segments Segments Text Disclosures (Details) $ in Thousands		3 Months Ended																12 Months Ended
		Dec. 31, 2016 USD ($)	[1]	Sep. 30, 2016 USD ($)	[1]	Jun. 30, 2016 USD ($)	[1]	Mar. 31, 2016 USD ($)	[1]	Dec. 31, 2015 USD ($)	[1]	Sep. 30, 2015 USD ($)	[1]	Jun. 30, 2015 USD ($)	[1]	Mar. 31, 2015 USD ($)	[1]	Dec. 31, 2016 USD ($) segments		Dec. 31, 2015 USD ($)		Dec. 31, 2014 USD ($)
Segment Reporting Information [Line Items]
Number of Reportable Segments | segments																		4
Restructuring expense																		$ 2,017		$ 3,724		$ 739
Impairment of goodwill																		9,528		0		0
Income from Discontinued Operations, Net of Tax, Including Portion Attributable to Noncontrolling Interest		$ 1,184		$ 1,047		$ 1,245		$ 2,065		$ 1,455		$ 1,316		$ 1,546		$ 2,094		5,541	[2]	6,411	[2]	6,160	[2]
Wealth Management and Trust Segment [Member]
Segment Reporting Information [Line Items]
Restructuring expense																		2,017		3,724		739
Impairment of goodwill																		9,528
Holding Company and Eliminations Segment [Member]
Segment Reporting Information [Line Items]
Income from Discontinued Operations, Net of Tax, Including Portion Attributable to Noncontrolling Interest	[3]																	$ 5,541		$ 6,411		$ 6,160

[1] Due to rounding, the sum of the four quarters may not add to the year to date total.

[2] The Company presents its EPS based on the treasury stock method. The Company reverted to the treasury stock presentation from the two-class presentation due to the immaterial number of participating shares outstanding as of March 31, 2016. If the EPS presentation had been based on the two-class method, the following adjustments would have been made to the presentation of EPS for the year ended December 31, 2016. Net income attributable to common shareholders would have been reduced by an additional $4 thousand, for the year ended December 31, 2016. The allocation of net income to participating securities would have been $8 thousand for the year ended December 31, 2016, reducing net income attributable to common shareholders by a total of $12 thousand for the same period. Basic EPS would not change. Weighted average diluted shared outstanding would have been reduced by 7,185 shares for the year ended December 31, 2016. Diluted EPS would not change. If the EPS presentation had been based on the two-class method, the following adjustments would have been made to the presentation of EPS for the year ended December 31, 2015. Net income attributable to common shareholders would have been reduced by an additional $90 thousand for the year ended December 31, 2015, and the allocation of net income to participating securities would have been $92 thousand for the same period, reducing net income attributable to common shareholders by a total of $182 thousand, for the same period. Total basic EPS and basic EPS from continuing operations would each decrease by $0.01 per share for the year ended December 31, 2015. Weighted average diluted shares outstanding would have been reduced by 167,937 shares for the same period. Diluted EPS would not change.If the EPS presentation had been based on the two-class method, the following adjustments would have been made to the presentation of EPS for the year ended December 31, 2014. Net income attributable to common shareholders would have been reduced by an additional$228 thousand for the year ended December 31, 2014, and the allocation of net income to participating securities would have been $335 thousand for the same period, reducing net income attributable to common shareholders by a total of $563 thousand, for the same period. Total basic EPS and basic EPS from continuing operations would each decrease by $0.01 per share for the year ended December 31, 2014. Weighted average diluted shares outstanding would have been reduced by 428,913 shares for the same period. Total diluted EPS and diluted EPS from discontinued operations would each decrease by $0.01 per share.

[3] The Holding Company and Eliminations calculation of Net Income attributable to the Company includes net income from Discontinued Operations for the years ended December 31, 2016, 2015 and 2014 of $5.5 million, $6.4 million, and $6.2 million, respectively