Investment Securities - Investments in continuous loss position (Details) (USD $) In Thousands, unless otherwise specified	6 Months Ended	12 Months Ended
	Jun. 30, 2014	Dec. 31, 2013
Schedule of Available-for-sale Securities
Less Than 12 Months, Fair value	$ 36,208	$ 117,325
Less Than 12 Months, Unrealized losses	435	3,654
12 Months or More, Fair value	71,118	18,095
12 Months or More, Unrealized losses	1,577	1,051
Total, Fair value	107,326	135,420
Total, Unrealized losses	2,012	4,705
U.S. government agencies
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions	4	1
Less Than 12 Months, Fair value	0	14,840
Less Than 12 Months, Unrealized losses	0	199
12 Months or More, Fair value	16,313	1,552
12 Months or More, Unrealized losses	92	8
Total, Fair value	16,313	16,392
Total, Unrealized losses	92	207
Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions	4
Less Than 12 Months, Fair value	28,053	49,954
Less Than 12 Months, Unrealized losses	409	1,247
12 Months or More, Fair value	13,449	0
12 Months or More, Unrealized losses	632	0
Total, Fair value	41,502	49,954
Total, Unrealized losses	1,041	1,247
Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions		1
Less Than 12 Months, Fair value	4,443	11,372
Less Than 12 Months, Unrealized losses	16	64
12 Months or More, Fair value	0	2,121
12 Months or More, Unrealized losses	0	38
Total, Fair value	4,443	13,493
Total, Unrealized losses	16	102
Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions	2	1
Less Than 12 Months, Fair value	3,712	9,941
Less Than 12 Months, Unrealized losses	10	194
12 Months or More, Fair value	4,995	142
12 Months or More, Unrealized losses	107	1
Total, Fair value	8,707	10,083
Total, Unrealized losses	117	195
State and municipal securities
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions	20	9
Less Than 12 Months, Fair value	0	31,218
Less Than 12 Months, Unrealized losses	0	1,950
12 Months or More, Fair value	36,361	14,280
12 Months or More, Unrealized losses	746	1,004
Total, Fair value	36,361	45,498
Total, Unrealized losses	746	2,954
Equity Securities [Member]
Schedule of Available-for-sale Securities
Less Than 12 Months, Fair value	0	0
Less Than 12 Months, Unrealized losses	0	0
12 Months or More, Fair value	0	0
12 Months or More, Unrealized losses	0	0
Total, Fair value	0	0
Total, Unrealized losses	$ 0	$ 0