Investment Securities - Amortized Cost and Fair Value (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Schedule of Available-for-sale Securities
Amortized Cost, Total available-for-sale securities	$ 288,914	$ 336,349
Unrealized Gains	4,713	7,766
Unrealized Losses	4,705	995
Fair Value, Total available-for-sale securities	288,922	343,120
US Government Agencies Debt Securities [Member]
Schedule of Available-for-sale Securities
Amortized Cost, Within 1 year	1,560	10,005
Amortized Cost, After 1 but within 5 years	15,039	17,479
Amortized Cost	16,599	27,484
Unrealized Gains	0	44
Unrealized Losses	207	1
Fair Value, Within 1 year	1,552	10,020
Fair Value, After 1 but within 5 years	14,840	17,507
Fair Value	16,392	27,527
Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Amortized Cost, Within 1 year	0	119
Amortized Cost, After 1 but within 5 years	632	315
Amortized Cost, After 5 but within 10 years	17,829	10,371
Amortized Cost, After 10 years	85,277	94,319
Amortized Cost	103,738	105,124
Unrealized Gains	950	2,458
Unrealized Losses	1,247	325
Fair Value, Within 1 year	0	121
Fair Value, After 1 but within 5 years	674	341
Fair Value, After 5 but within 10 years	18,113	10,712
Fair Value, After 10 years	84,654	96,083
Fair Value	103,441	107,257
Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Amortized Cost, After 1 but within 5 years	3,139	648
Amortized Cost, After 5 but within 10 years	5,093	9,975
Amortized Cost, After 10 years	43,813	111,155
Amortized Cost	52,045	121,778
Unrealized Gains	800	1,110
Unrealized Losses	102	295
Fair Value, After 1 but within 5 years	3,132	650
Fair Value, After 5 but within 10 years	5,233	10,178
Fair Value, After 10 years	44,378	111,765
Fair Value	52,743	122,593
Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Amortized Cost, After 5 but within 10 years	143	178
Amortized Cost, After 10 years	14,530	848
Amortized Cost	14,673	1,026
Unrealized Gains	13	19
Unrealized Losses	195	0
Fair Value, After 5 but within 10 years	142	178
Fair Value, After 10 years	14,349	867
Fair Value	14,491	1,045
US States and Political Subdivisions Debt Securities [Member]
Schedule of Available-for-sale Securities
Amortized Cost, Within 1 year	910	620
Amortized Cost, After 1 but within 5 years	7,069	5,734
Amortized Cost, After 5 but within 10 years	44,590	24,464
Amortized Cost, After 10 years	47,422	50,031
Amortized Cost	99,991	80,849
Unrealized Gains	1,667	4,089
Unrealized Losses	2,954	373
Fair Value, Within 1 year	920	626
Fair Value, After 1 but within 5 years	7,380	6,055
Fair Value, After 5 but within 10 years	44,827	26,150
Fair Value, After 10 years	45,577	51,734
Fair Value	98,704	84,565
Common and preferred stocks
Schedule of Available-for-sale Securities
Amortized Cost, Common and preferred stocks	1,868	88
Unrealized Gains	1,283	46
Unrealized Losses	0	1
Fair Value, Common and preferred stocks	3,151	133
Within 1 year | US Government Agencies Debt Securities [Member]
Schedule of Available-for-sale Securities
Unrealized Gains	0	15
Unrealized Losses	8	0
Within 1 year | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	0	2
Unrealized Losses	0	0
Within 1 year | US States and Political Subdivisions Debt Securities [Member]
Schedule of Available-for-sale Securities
Unrealized Gains	10	6
Unrealized Losses	0	0
After 1 but within 5 years | US Government Agencies Debt Securities [Member]
Schedule of Available-for-sale Securities
Unrealized Gains	0	29
Unrealized Losses	199	1
After 1 but within 5 years | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	42	26
Unrealized Losses	0	0
After 1 but within 5 years | Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	0	2
Unrealized Losses	7	0
After 1 but within 5 years | US States and Political Subdivisions Debt Securities [Member]
Schedule of Available-for-sale Securities
Unrealized Gains	311	321
Unrealized Losses	0	0
After 5 but within 10 years | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	284	341
Unrealized Losses	0	0
After 5 but within 10 years | Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	140	206
Unrealized Losses	0	3
After 5 but within 10 years | Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	0	0
Unrealized Losses	1	0
After 5 but within 10 years | US States and Political Subdivisions Debt Securities [Member]
Schedule of Available-for-sale Securities
Unrealized Gains	1,064	1,698
Unrealized Losses	827	12
After 10 years | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	624	2,089
Unrealized Losses	1,247	325
After 10 years | Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	660	902
Unrealized Losses	95	292
After 10 years | Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	13	19
Unrealized Losses	194	0
After 10 years | US States and Political Subdivisions Debt Securities [Member]
Schedule of Available-for-sale Securities
Unrealized Gains	282	2,064
Unrealized Losses	$ 2,127	$ 361