Investment Securities - Unrealized Loss on Investments (Details 2) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2014	Dec. 31, 2013
Schedule of Available-for-sale Securities [Line Items]
Less than 12 Months, Fair Value	$ 61,046	$ 73,523
Less than 12 Months, Unrealized Losses	(1,967)	(3,390)
12 Months or More, Fair Value	8,811	3,380
12 Months or More, Unrealized Losses	(751)	(601)
Total, Fair Value	69,857	76,903
Total, Unrealized Losses	(2,718)	(3,991)
Federal agencies
Schedule of Available-for-sale Securities [Line Items]
Less than 12 Months, Fair Value	20,892	21,518
Less than 12 Months, Unrealized Losses	(721)	(962)
12 Months or More, Fair Value	1,894	1,876
12 Months or More, Unrealized Losses	(106)	(124)
Total, Fair Value	22,786	23,394
Total, Unrealized Losses	(827)	(1,086)
State and municipal
Schedule of Available-for-sale Securities [Line Items]
Less than 12 Months, Fair Value	8,526	18,556
Less than 12 Months, Unrealized Losses	(348)	(1,271)
12 Months or More, Fair Value	3,153	540
12 Months or More, Unrealized Losses	(222)	(64)
Total, Fair Value	11,679	19,096
Total, Unrealized Losses	(570)	(1,335)
Government-sponsored enterprise (GSE) residential mortgage-backed and other asset-backed agency securities
Schedule of Available-for-sale Securities [Line Items]
Less than 12 Months, Fair Value	30,129	30,717
Less than 12 Months, Unrealized Losses	(895)	(1,131)
12 Months or More, Fair Value	2,663	444
12 Months or More, Unrealized Losses	(117)	(26)
Total, Fair Value	32,792	31,161
Total, Unrealized Losses	(1,012)	(1,157)
Corporate
Schedule of Available-for-sale Securities [Line Items]
Less than 12 Months, Fair Value	1,499	2,732
Less than 12 Months, Unrealized Losses	(3)	(26)
12 Months or More, Fair Value	1,101	520
12 Months or More, Unrealized Losses	(306)	(387)
Total, Fair Value	2,600	3,252
Total, Unrealized Losses	$ (309)	$ (413)