Investment Securities - Amortized Cost and Fair Value (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2014	Dec. 31, 2013
Schedule of Available-for-sale Securities
Amortized Cost, Total available-for-sale securities	$ 265,842	$ 288,914
Unrealized Gains	4,457	4,713
Unrealized Losses	3,206	4,705
Available-for-sale securities	267,093	288,922	[1]
Securities of U.S. government agencies
Schedule of Available-for-sale Securities
Amortized Cost, Within 1 year	1,464	1,560
Amortized Cost, After 1 but within 5 years	15,036	15,039
Amortized Cost	16,500	16,599
Unrealized Gains	0	0
Unrealized Losses	176	207
Fair Value, Within 1 year	1,459	1,552
Fair Value, After 1 but within 5 years	14,865	14,840
Fair Value	16,324	16,392
Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Amortized Cost, After 1 but within 5 years	566	632
Amortized Cost, After 5 but within 10 years	20,445	17,829
Amortized Cost, After 10 years	82,367	85,277
Amortized Cost	103,378	103,738
Unrealized Gains	1,005	950
Unrealized Losses	1,198	1,247
Fair Value, After 1 but within 5 years	603	674
Fair Value, After 5 but within 10 years	20,732	18,113
Fair Value, After 10 years	81,850	84,654
Fair Value	103,185	103,441
Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Amortized Cost, After 1 but within 5 years	2,860	3,139
Amortized Cost, After 5 but within 10 years	4,917	5,093
Amortized Cost, After 10 years	40,194	43,813
Amortized Cost	47,971	52,045
Unrealized Gains	790	800
Unrealized Losses	21	102
Fair Value, After 1 but within 5 years	2,854	3,132
Fair Value, After 5 but within 10 years	5,060	5,233
Fair Value, After 10 years	40,826	44,378
Fair Value	48,740	52,743
Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Amortized Cost, After 5 but within 10 years	132	143
Amortized Cost, After 10 years	13,561	14,530
Amortized Cost	13,693	14,673
Unrealized Gains	24	13
Unrealized Losses	123	195
Fair Value, After 5 but within 10 years	142	142
Fair Value, After 10 years	13,452	14,349
Fair Value	13,594	14,491
State and municipal securities
Schedule of Available-for-sale Securities
Amortized Cost, Within 1 year	910	910
Amortized Cost, After 1 but within 5 years	8,966	7,069
Amortized Cost, After 5 but within 10 years	36,501	44,590
Amortized Cost, After 10 years	36,054	47,422
Amortized Cost	82,431	99,991
Unrealized Gains	1,435	1,667
Unrealized Losses	1,688	2,954
Fair Value, Within 1 year	914	920
Fair Value, After 1 but within 5 years	9,314	7,380
Fair Value, After 5 but within 10 years	36,802	44,827
Fair Value, After 10 years	35,148	45,577
Fair Value	82,178	98,704
Equity Securities [Member]
Schedule of Available-for-sale Securities
Amortized Cost, Common and preferred stocks	1,869	1,868
Unrealized Gains	1,203	1,283
Unrealized Losses	0	0
Fair Value, Common and preferred stocks	3,072	3,151
Within 1 year | Securities of U.S. government agencies
Schedule of Available-for-sale Securities
Unrealized Gains	0	0
Unrealized Losses	5	8
Within 1 year | State and municipal securities
Schedule of Available-for-sale Securities
Unrealized Gains	4	10
Unrealized Losses	0	0
After 1 but within 5 years | Securities of U.S. government agencies
Schedule of Available-for-sale Securities
Unrealized Gains	0	0
Unrealized Losses	171	199
After 1 but within 5 years | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	37	42
Unrealized Losses	0	0
After 1 but within 5 years | Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	0	0
Unrealized Losses	6	7
After 1 but within 5 years | State and municipal securities
Schedule of Available-for-sale Securities
Unrealized Gains	352	311
Unrealized Losses	4	0
After 5 but within 10 years | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	328	284
Unrealized Losses	41	0
After 5 but within 10 years | Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	143	140
Unrealized Losses	0	0
After 5 but within 10 years | Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	10	0
Unrealized Losses	0	1
After 5 but within 10 years | State and municipal securities
Schedule of Available-for-sale Securities
Unrealized Gains	850	1,064
Unrealized Losses	549	827
After 10 years | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	640	624
Unrealized Losses	1,157	1,247
After 10 years | Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	647	660
Unrealized Losses	15	95
After 10 years | Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	14	13
Unrealized Losses	123	194
After 10 years | State and municipal securities
Schedule of Available-for-sale Securities
Unrealized Gains	229	282
Unrealized Losses	$ 1,135	$ 2,127

[1] Derived from audited consolidated financial statements