Discontinued Operations - Net Income (loss) (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2016	Jun. 30, 2015	Jun. 30, 2016	Jun. 30, 2015
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Insurance and investment services income	$ 122	$ 107	$ 175	$ 178
Other operating income	126	47	343	215
Total noninterest income	12,001	9,647	20,613	19,419
Salary and employee benefits	11,735	9,292	22,044	18,140
Occupancy expense	901	812	1,839	1,622
Equipment depreciation and maintenance	586	470	1,146	939
Data processing and communications	1,256	920	2,381	1,819
Marketing, contributions and sponsorships	350	350	647	681
Professional fees	838	617	1,543	1,277
Printing, postage and supplies	202	165	417	347
Insurance, tax and assessment expense	359	399	732	809
Travel, entertainment, dues and subscriptions	451	402	819	696
Other operating expenses	285	328	434	561
Total noninterest expense	17,756	14,545	33,656	28,427
Income from discontinued operations, before income taxes	6,516	(279)	6,346	275
Income tax expense - discontinued operations	2,475	(105)	2,411	106
Net Income from discontinued operations	4,041	(174)	3,935	169
USI Insurance Services [Member]
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Insurance and investment services income	823	859	1,887	2,485
Gain on sale of subsidiary	6,926		6,926
Other operating income	1	5	2	5
Total noninterest income	7,750	864	8,815	2,490
Salary and employee benefits	986	902	1,937	1,788
Occupancy expense	52	67	124	133
Equipment depreciation and maintenance	15	13	29	28
Data processing and communications	39	24	79	51
Marketing, contributions and sponsorships	4	9	7	15
Professional fees	2	1	2	4
Printing, postage and supplies	5	5	12	9
Insurance, tax and assessment expense	32	20	58	38
Travel, entertainment, dues and subscriptions	41	30	67	56
Other operating expenses	58	72	154	93
Total noninterest expense	1,234	1,143	2,469	2,215
Income from discontinued operations, before income taxes	6,516	(279)	6,346	275
Income tax expense - discontinued operations	2,475	(105)	2,411	106
Net Income from discontinued operations	$ 4,041	$ (174)	$ 3,935	$ 169