Business Combinations Business Combinations (Details) - USD ($) $ / shares in Units, $ in Thousands				3 Months Ended		6 Months Ended
	May 19, 2016	May 07, 2016	Feb. 14, 2015	Jun. 30, 2016	Jun. 30, 2015	Jun. 30, 2016	Jun. 30, 2015	May 06, 2016	Mar. 11, 2016	Feb. 13, 2015
Business Acquisition [Line Items]
Business Combination, Consideration Transferred	$ 35,000
Certain Loans Acquired in Transfer Accounted for as Debt Securities, Acquired During Period, at Acquisition, at Fair Value				$ 80,084		$ 80,084			$ 80,084	$ 154,496
Gain on acquisition				3,290	$ 0	4,994	$ 42,930
Merger-related expenses				1,385	$ 4,573	1,423	$ 7,570
Cordia Bancorp Inc.
Business Acquisition [Line Items]
Business Acquisition, Share Price	$ 5.15
First CornerStone Bank
Business Acquisition [Line Items]
Cash and cash equivalents								$ 748
Overnight investments								37,540
Investment securities available for sale								4,564
Certain Loans Acquired in Transfer Accounted for as Debt Securities, Acquired During Period, at Acquisition, at Fair Value								43,170
Other real estate owned								144
Business Combination Assets and Liabilities Acquired Income Earned Not Collected								8
Intangible asset								390
Other assets								13
Total assets acquired								86,577
Deposits								96,882
Other liabilities								23
Total liabilities assumed								96,905
Fair value of net assets (liabilities) assumed								(10,328)
Cash received from FDIC								$ 12,450
Gain on acquisition		$ 2,122
Merger-related expenses						793
Revenue generated				324
North Milwaukee State Bank
Business Acquisition [Line Items]
Cash and cash equivalents									4,545
Overnight investments									2,274
Investment securities available for sale									9,425
Certain Loans Acquired in Transfer Accounted for as Debt Securities, Acquired During Period, at Acquisition, at Fair Value									36,914
Intangible asset									240
Other assets									216
Total assets acquired									53,614
Deposits									59,206
Business Combination, Provisional Information, Initial Accounting Incomplete, Adjustments Related to Previous Period				1,200
Short-term borrowings									1,662
Other liabilities									74
Total liabilities assumed									60,942
Fair value of net assets (liabilities) assumed									(7,328)
Cash received from FDIC									$ 10,200
Gain on acquisition			$ 2,872
Merger-related expenses				438		476
Revenue generated				$ 676		$ 799