Investment Securities (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2014	Dec. 31, 2013
Available for sale (AFS)
Amortized Cost	$ 274,384	$ 291,899
Gross Unrealized Gains	6,595	5,601
Gross Unrealized Losses	(4,946)	(8,888)
Fair Value	276,033	288,612
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	91,470	130,175
Gross Unrealized Losses, Less than Twelve Months	(2,068)	(5,953)
Fair value, Twelve Months or Greater	28,546	9,600
Gross Unrealized Losses, Twelve Months or Greater	(2,878)	(2,935)
Fair Value, Total	120,016	139,775
Gross Unrealized Losses, Total	(4,946)	(8,888)
Debt securities
Available for sale (AFS)
Amortized Cost	262,456	280,715
Gross Unrealized Gains	4,743	3,753
Gross Unrealized Losses	(4,863)	(8,821)
Fair Value	262,336	275,647
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	89,915	129,901
Gross Unrealized Losses, Less than Twelve Months	(2,027)	(5,931)
Fair value, Twelve Months or Greater	27,746	8,945
Gross Unrealized Losses, Twelve Months or Greater	(2,836)	(2,890)
Fair Value, Total	117,661	138,846
Gross Unrealized Losses, Total	(4,863)	(8,821)
U.S. Government and agency securities
Available for sale (AFS)
Amortized Cost	9,403	9,989
Gross Unrealized Gains	34	17
Gross Unrealized Losses	(191)	(83)
Fair Value	9,246	9,923
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	3,696	7,740
Gross Unrealized Losses, Less than Twelve Months	(32)	(83)
Fair value, Twelve Months or Greater	3,837	0
Gross Unrealized Losses, Twelve Months or Greater	(159)	0
Fair Value, Total	7,533	7,740
Gross Unrealized Losses, Total	(191)	(83)
Mortgage-backed Securities, Issued by US Government Sponsored Enterprises [Member]
Available for sale (AFS)
Amortized Cost	13,037	9,966
Gross Unrealized Gains	644	694
Gross Unrealized Losses	(59)	(68)
Fair Value	13,622	10,592
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	6,386	2,483
Gross Unrealized Losses, Less than Twelve Months	(59)	(68)
Fair value, Twelve Months or Greater	0	0
Gross Unrealized Losses, Twelve Months or Greater	0	0
Fair Value, Total	6,386	2,483
Gross Unrealized Losses, Total	(59)	(68)
Asset-backed Securities [Member]
Available for sale (AFS)
Amortized Cost	2,629	6,700
Gross Unrealized Gains	38	43
Gross Unrealized Losses	(5)	(179)
Fair Value	2,662	6,564
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	0	3,847
Gross Unrealized Losses, Less than Twelve Months	0	(177)
Fair value, Twelve Months or Greater	660	712
Gross Unrealized Losses, Twelve Months or Greater	(5)	(2)
Fair Value, Total	660	4,559
Gross Unrealized Losses, Total	(5)	(179)
State and political securities
Available for sale (AFS)
Amortized Cost	132,585	145,121
Gross Unrealized Gains	3,155	2,120
Gross Unrealized Losses	(2,757)	(5,446)
Fair Value	132,983	141,795
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	22,563	42,577
Gross Unrealized Losses, Less than Twelve Months	(674)	(2,558)
Fair value, Twelve Months or Greater	11,217	8,233
Gross Unrealized Losses, Twelve Months or Greater	(2,083)	(2,888)
Fair Value, Total	33,780	50,810
Gross Unrealized Losses, Total	(2,757)	(5,446)
Other debt securities
Available for sale (AFS)
Amortized Cost	104,802	108,939
Gross Unrealized Gains	872	879
Gross Unrealized Losses	(1,851)	(3,045)
Fair Value	103,823	106,773
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	57,270	73,254
Gross Unrealized Losses, Less than Twelve Months	(1,262)	(3,045)
Fair value, Twelve Months or Greater	12,032	0
Gross Unrealized Losses, Twelve Months or Greater	(589)	0
Fair Value, Total	69,302	73,254
Gross Unrealized Losses, Total	(1,851)	(3,045)
Other equity securities
Available for sale (AFS)
Amortized Cost	11,928	11,184
Gross Unrealized Gains	1,852	1,848
Gross Unrealized Losses	(83)	(67)
Fair Value	13,697	12,965
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	1,555	274
Gross Unrealized Losses, Less than Twelve Months	(41)	(22)
Fair value, Twelve Months or Greater	800	655
Gross Unrealized Losses, Twelve Months or Greater	(42)	(45)
Fair Value, Total	2,355	929
Gross Unrealized Losses, Total	(83)	(67)
Financial institution equity securities
Available for sale (AFS)
Amortized Cost	8,079	8,842
Gross Unrealized Gains	1,760	1,820
Gross Unrealized Losses	(1)	0
Fair Value	9,838	10,662
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	182	0
Gross Unrealized Losses, Less than Twelve Months	(1)	0
Fair value, Twelve Months or Greater	0	0
Gross Unrealized Losses, Twelve Months or Greater	0	0
Fair Value, Total	182	0
Gross Unrealized Losses, Total	(1)	0
Other equity securities
Available for sale (AFS)
Amortized Cost	3,849	2,342
Gross Unrealized Gains	92	28
Gross Unrealized Losses	(82)	(67)
Fair Value	3,859	2,303
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	1,373	274
Gross Unrealized Losses, Less than Twelve Months	(40)	(22)
Fair value, Twelve Months or Greater	800	655
Gross Unrealized Losses, Twelve Months or Greater	(42)	(45)
Fair Value, Total	2,173	929
Gross Unrealized Losses, Total	$ (82)	$ (67)