Investment Securities - Investments in continuous loss position (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended	12 Months Ended
	Mar. 31, 2014	Dec. 31, 2013
Schedule of Available-for-sale Securities
Less Than 12 Months, Fair value	$ 85,615	$ 117,325
Less Than 12 Months, Unrealized losses	1,739	3,654
12 Months or More, Fair value	32,470	18,095
12 Months or More, Unrealized losses	1,467	1,051
Total, Fair value	118,085	135,420
Total, Unrealized losses	3,206	4,705
U.S. government agencies
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions	1	1
Less Than 12 Months, Fair value	14,865	14,840
Less Than 12 Months, Unrealized losses	171	199
12 Months or More, Fair value	1,459	1,552
12 Months or More, Unrealized losses	5	8
Total, Fair value	16,324	16,392
Total, Unrealized losses	176	207
Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions	2
Less Than 12 Months, Fair value	36,232	49,954
Less Than 12 Months, Unrealized losses	789	1,247
12 Months or More, Fair value	7,964	0
12 Months or More, Unrealized losses	409	0
Total, Fair value	44,196	49,954
Total, Unrealized losses	1,198	1,247
Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions		1
Less Than 12 Months, Fair value	7,054	11,372
Less Than 12 Months, Unrealized losses	21	64
12 Months or More, Fair value	0	2,121
12 Months or More, Unrealized losses	0	38
Total, Fair value	7,054	13,493
Total, Unrealized losses	21	102
Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions	1	1
Less Than 12 Months, Fair value	5,851	9,941
Less Than 12 Months, Unrealized losses	21	194
12 Months or More, Fair value	3,521	142
12 Months or More, Unrealized losses	102	1
Total, Fair value	9,372	10,083
Total, Unrealized losses	123	195
State and municipal securities
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions	13	9
Less Than 12 Months, Fair value	21,613	31,218
Less Than 12 Months, Unrealized losses	737	1,950
12 Months or More, Fair value	19,526	14,280
12 Months or More, Unrealized losses	951	1,004
Total, Fair value	41,139	45,498
Total, Unrealized losses	1,688	2,954
Equity Securities [Member]
Schedule of Available-for-sale Securities
Less Than 12 Months, Fair value	0	0
Less Than 12 Months, Unrealized losses	0	0
12 Months or More, Fair value	0	0
12 Months or More, Unrealized losses	0	0
Total, Fair value	0	0
Total, Unrealized losses	$ 0	$ 0