Investment Securities - Unrealized Loss on Investments (Details 2) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2014	Dec. 31, 2013
Schedule of Available-for-sale Securities [Line Items]
Less than 12 Months, Fair Value	$ 20,907	$ 73,523
Less than 12 Months, Unrealized Losses	(267)	(3,390)
12 Months or More, Fair Value	23,254	3,380
12 Months or More, Unrealized Losses	(865)	(601)
Total, Fair Value	44,161	76,903
Total, Unrealized Losses	(1,132)	(3,991)
Federal agencies
Schedule of Available-for-sale Securities [Line Items]
Less than 12 Months, Fair Value	12,302	21,518
Less than 12 Months, Unrealized Losses	(178)	(962)
12 Months or More, Fair Value	8,756	1,876
12 Months or More, Unrealized Losses	(241)	(124)
Total, Fair Value	21,058	23,394
Total, Unrealized Losses	(419)	(1,086)
State and municipal
Schedule of Available-for-sale Securities [Line Items]
Less than 12 Months, Fair Value	1,651	18,556
Less than 12 Months, Unrealized Losses	(14)	(1,271)
12 Months or More, Fair Value	2,706	540
12 Months or More, Unrealized Losses	(33)	(64)
Total, Fair Value	4,357	19,096
Total, Unrealized Losses	(47)	(1,335)
Government-sponsored enterprise (GSE) residential mortgage-backed and other asset-backed agency securities
Schedule of Available-for-sale Securities [Line Items]
Less than 12 Months, Fair Value	6,230	30,717
Less than 12 Months, Unrealized Losses	(74)	(1,131)
12 Months or More, Fair Value	10,697	444
12 Months or More, Unrealized Losses	(276)	(26)
Total, Fair Value	16,927	31,161
Total, Unrealized Losses	(350)	(1,157)
Corporate
Schedule of Available-for-sale Securities [Line Items]
Less than 12 Months, Fair Value	724	2,732
Less than 12 Months, Unrealized Losses	(1)	(26)
12 Months or More, Fair Value	1,095	520
12 Months or More, Unrealized Losses	(315)	(387)
Total, Fair Value	1,819	3,252
Total, Unrealized Losses	$ (316)	$ (413)