Investment Securities - Summary of Unrealized Losses of Available-for-Sale Securities (Details) - USD ($) $ in Thousands	Sep. 30, 2016	Dec. 31, 2015
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	$ 56,308	$ 165,890
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	214	1,471
Available-for-sale, Securities with losses over 12 months, Fair Value	14,586	32,975
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	178	1,134
Available-for-sale, Total, Fair Value	70,894	198,865
Available-for-sale, Total, Gross Unrealized Loss	392	2,605
Obligations of state and political subdivisions
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	5,517	1,192
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	29	27
Available-for-sale, Securities with losses over 12 months, Fair Value	0	0
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	0	0
Available-for-sale, Total, Fair Value	5,517	1,192
Available-for-sale, Total, Gross Unrealized Loss	29	27
GSE mortgage-backed securities
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value		21,607
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss		229
Available-for-sale, Securities with losses over 12 months, Fair Value		0
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss		0
Available-for-sale, Total, Fair Value		21,607
Available-for-sale, Total, Gross Unrealized Loss		229
Collateralized mortgage obligations: residential
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	49,802	140,999
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	182	1,207
Available-for-sale, Securities with losses over 12 months, Fair Value	12,111	30,029
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	149	1,069
Available-for-sale, Total, Fair Value	61,913	171,028
Available-for-sale, Total, Gross Unrealized Loss	331	2,276
Collateralized mortgage obligations: commercial
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value	989	0
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss	3	0
Available-for-sale, Securities with losses over 12 months, Fair Value	2,475	2,946
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss	29	65
Available-for-sale, Total, Fair Value	3,464	2,946
Available-for-sale, Total, Gross Unrealized Loss	$ 32	65
Mutual funds
Schedule of Available-for-sale Securities [Line Items]
Available-for-sale, Securities with losses under 12 months, Fair Value		2,092
Available-for-sale, Securities with losses under 12 months, Gross Unrealized Loss		8
Available-for-sale, Securities with losses over 12 months, Fair Value		0
Available-for-sale, Securities with losses over 12 months, Gross Unrealized Loss		0
Available-for-sale, Total, Fair Value		2,092
Available-for-sale, Total, Gross Unrealized Loss		$ 8