Investment Securities (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013
Available for sale (AFS)
Amortized Cost	$ 229,825	$ 291,899
Gross Unrealized Gains	6,247	5,601
Gross Unrealized Losses	(2,438)	(8,888)
Fair Value	233,634	288,612
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	31,999	130,175
Gross Unrealized Losses, Less than Twelve Months	(705)	(5,953)
Fair value, Twelve Months or Greater	40,950	9,600
Gross Unrealized Losses, Twelve Months or Greater	(1,733)	(2,935)
Fair Value, Total	72,949	139,775
Gross Unrealized Losses, Total	(2,438)	(8,888)
Debt securities
Available for sale (AFS)
Amortized Cost	218,091	280,715
Gross Unrealized Gains	5,245	3,753
Gross Unrealized Losses	(2,316)	(8,821)
Fair Value	221,020	275,647
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	31,264	129,901
Gross Unrealized Losses, Less than Twelve Months	(617)	(5,931)
Fair value, Twelve Months or Greater	40,184	8,945
Gross Unrealized Losses, Twelve Months or Greater	(1,699)	(2,890)
Fair Value, Total	71,448	138,846
Gross Unrealized Losses, Total	(2,316)	(8,821)
U.S. Government and agency securities
Available for sale (AFS)
Amortized Cost	5,935	9,989
Gross Unrealized Gains	1	17
Gross Unrealized Losses	(140)	(83)
Fair Value	5,796	9,923
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	1,010	7,740
Gross Unrealized Losses, Less than Twelve Months	(1)	(83)
Fair value, Twelve Months or Greater	3,816	0
Gross Unrealized Losses, Twelve Months or Greater	(139)	0
Fair Value, Total	4,826	7,740
Gross Unrealized Losses, Total	(140)	(83)
Mortgage-backed securities
Available for sale (AFS)
Amortized Cost	10,689	9,966
Gross Unrealized Gains	495	694
Gross Unrealized Losses	(49)	(68)
Fair Value	11,135	10,592
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	3,903	2,483
Gross Unrealized Losses, Less than Twelve Months	(40)	(68)
Fair value, Twelve Months or Greater	891	0
Gross Unrealized Losses, Twelve Months or Greater	(9)	0
Fair Value, Total	4,794	2,483
Gross Unrealized Losses, Total	(49)	(68)
Asset-backed securities
Available for sale (AFS)
Amortized Cost	2,536	6,700
Gross Unrealized Gains	38	43
Gross Unrealized Losses	(3)	(179)
Fair Value	2,571	6,564
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	0	3,847
Gross Unrealized Losses, Less than Twelve Months	0	(177)
Fair value, Twelve Months or Greater	567	712
Gross Unrealized Losses, Twelve Months or Greater	(3)	(2)
Fair Value, Total	567	4,559
Gross Unrealized Losses, Total	(3)	(179)
State and political securities
Available for sale (AFS)
Amortized Cost	108,801	145,121
Gross Unrealized Gains	3,779	2,120
Gross Unrealized Losses	(798)	(5,446)
Fair Value	111,782	141,795
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	1,816	42,577
Gross Unrealized Losses, Less than Twelve Months	(11)	(2,558)
Fair value, Twelve Months or Greater	7,722	8,233
Gross Unrealized Losses, Twelve Months or Greater	(787)	(2,888)
Fair Value, Total	9,538	50,810
Gross Unrealized Losses, Total	(798)	(5,446)
Other debt securities
Available for sale (AFS)
Amortized Cost	90,130	108,939
Gross Unrealized Gains	932	879
Gross Unrealized Losses	(1,326)	(3,045)
Fair Value	89,736	106,773
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	24,535	73,254
Gross Unrealized Losses, Less than Twelve Months	(565)	(3,045)
Fair value, Twelve Months or Greater	27,188	0
Gross Unrealized Losses, Twelve Months or Greater	(761)	0
Fair Value, Total	51,723	73,254
Gross Unrealized Losses, Total	(1,326)	(3,045)
Other equity securities
Available for sale (AFS)
Amortized Cost	11,734	11,184
Gross Unrealized Gains	1,002	1,848
Gross Unrealized Losses	(122)	(67)
Fair Value	12,614	12,965
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	735	274
Gross Unrealized Losses, Less than Twelve Months	(88)	(22)
Fair value, Twelve Months or Greater	766	655
Gross Unrealized Losses, Twelve Months or Greater	(34)	(45)
Fair Value, Total	1,501	929
Gross Unrealized Losses, Total	(122)	(67)
Financial institution equity securities
Available for sale (AFS)
Amortized Cost	8,304	8,842
Gross Unrealized Gains	938	1,820
Gross Unrealized Losses	(21)	0
Fair Value	9,221	10,662
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	369	0
Gross Unrealized Losses, Less than Twelve Months	(21)	0
Fair value, Twelve Months or Greater	0	0
Gross Unrealized Losses, Twelve Months or Greater	0	0
Fair Value, Total	369	0
Gross Unrealized Losses, Total	(21)	0
Other equity securities
Available for sale (AFS)
Amortized Cost	3,430	2,342
Gross Unrealized Gains	64	28
Gross Unrealized Losses	(101)	(67)
Fair Value	3,393	2,303
Gross unrealized losses and fair value
Fair Value, Less than Twelve Months	366	274
Gross Unrealized Losses, Less than Twelve Months	(67)	(22)
Fair value, Twelve Months or Greater	766	655
Gross Unrealized Losses, Twelve Months or Greater	(34)	(45)
Fair Value, Total	1,132	929
Gross Unrealized Losses, Total	$ (101)	$ (67)