Investment Securities (Details) (USD $)	6 Months Ended		12 Months Ended
	Jun. 30, 2014 Label Security	Jun. 30, 2013 Security	Dec. 31, 2013
Available-for-sale Securities [Abstract]
Amortized Cost	$ 296,798,000		$ 341,828,000
Gross Unrealized Gains	7,200,000		5,576,000
Gross Unrealized Losses	2,970,000		5,739,000
Fair Value	301,028,000		341,665,000
Held-to-maturity [Abstract]
Amortized Cost	148,927,000		155,523,000	[1]
Gross Unrealized Gains	1,152,000		289,000
Gross Unrealized Losses	1,520,000		4,644,000
Fair Value	148,559,000		151,168,000
Number of Private label Collateralized Mortgage Obligations	3
Combined balance of private-label collateralized mortgage obligations	53,000
Available-for-sale, Amortized Cost [Abstract]
Due in one year or less	10,544,000
Due after one year through five years	33,691,000
Due after five years through ten years	12,376,000
Due after ten years	5,171,000
Other asset-backed securities	24,681,000
Mortgage-backed securities and collateralized mortgage obligations: Residential, Amortized Cost	183,140,000
Mortgage-backed securities and collateralized mortgage obligations: Commercial, Amortized Cost	26,731,000
Collateralized debt obligation	464,000
Amortized Cost	296,798,000		341,828,000
Available-for-sale, Fair Value [Abstract]
Due in one year or less	10,705,000
Due after one year through five years	34,681,000
Due after five years through ten years	13,116,000
Due after ten years	5,162,000
Other asset-backed securities	25,085,000
Mortgage-backed securities and collateralized mortgage obligations: Residential, Fair Value	183,936,000
Mortgage-backed securities and collateralized mortgage obligations: Commercial, Fair Value	27,018,000
Collateralized debt obligation	1,325,000
Fair Value	301,028,000		341,665,000
Held-to-maturity, Amortized Cost [Abstract]
Due in one year or less	107,000
Due after one year through five years	2,639,000
Due after five years through ten years	6,910,000
Due after ten years	37,148,000
Mortgage-backed securities and collateralized mortgage obligations: Residential, Amortized Cost	86,569,000
Mortgage-backed securities and collateralized mortgage obligations: Commercial, Amortized Cost	15,554,000
Amortized Cost	148,927,000		155,523,000	[1]
Held-to-maturity, Fair Value [Abstract]
Due in one year or less	105,000
Due after one year through five years	2,659,000
Due after five years through ten years	6,831,000
Due after ten years	36,627,000
Mortgage-backed securities and collateralized mortgage obligations: Residential, Fair Value	86,705,000
Mortgage-backed securities and collateralized mortgage obligations: Commercial, Fair Value	15,632,000
Held-to-maturity securities, Fair Value	148,559,000		151,168,000
Available-for-sale [Abstract]
Securities with losses under 12 months, Fair Value, Available-for-sale	9,048,000		157,103,000
Securities with losses under 12 months, Gross Unrealized Loss, Available-for-sale	35,000		5,408,000
Securities with losses over 12 months, Fair Value, Available-for-sale	104,442,000		4,371,000
Securities with losses over 12 months, Gross Unrealized Loss, Available-for-sale	2,935,000		331,000
Total securities, Fair Value, Available-for-sale	113,490,000		161,474,000
Total securities, Gross Unrealized Loss, Available-for-sale	2,970,000		5,739,000
Held-to-maturity [Abstract]
Securities with losses under 12 months, Fair Value, Held-to-maturity	7,816,000		86,498,000
Securities with losses under 12 months, Gross Unrealized Loss, Held-to-maturity	59,000		4,627,000
Securities with losses over 12 months, Fair Value, Held-to-maturity	72,715,000		685,000
Securities with losses over 12 months, Gross Unrealized Loss, Held-to-maturity	1,461,000		17,000
Total securities, Fair Value, Held-to-maturity	80,531,000		87,183,000
Total securities, Gross Unrealized Loss, Held-to-maturity	1,520,000		4,644,000
Number of available-for-sale and held-to-maturity securities in unrealized loss positions	90
Unrealized losses as a percentage of individual securities' amortized cost basis (in hundredths)	2.26%
Unrealized losses as a percentage of the Company's total amortized cost basis (in hundredths)	1.01%
Number of available-for-sale securities in continuous loss position	70
Unamortized cost basis of securities in a continuous loss position	181,600,000
Unrealized loss on securities in a continuous loss position	4,500,000
Number of impairment related to credit quality	0
Number of impaired securities evaluated as other temporary	0
Impairment losses recognized on debt securities	0
Number of available-for-sale securities sold	4	21
Available-for-sale securities, net gain	128,000	204,000
Number of available-for-sale securities sold with gains	4	18
Available-for-sale securities, gross realized gains	128,000	217,000
Number of available-for-sale securities sold with loss		3
Available-for-sale securities, gross realized losses		13,000
Securities pledged to secure public funds on deposits and for other purposes required or permitted by law	283,300,000		259,900,000
U.S. Government Sponsored Enterprises [Member]
Available-for-sale Securities [Abstract]
Amortized Cost	11,201,000		11,455,000
Gross Unrealized Gains	1,000		1,000
Gross Unrealized Losses	111,000		191,000
Fair Value	11,091,000		11,265,000
Available-for-sale, Amortized Cost [Abstract]
Amortized Cost	11,201,000		11,455,000
Available-for-sale, Fair Value [Abstract]
Fair Value	11,091,000		11,265,000
Available-for-sale [Abstract]
Securities with losses under 12 months, Fair Value, Available-for-sale	0		10,463,000
Securities with losses under 12 months, Gross Unrealized Loss, Available-for-sale	0		191,000
Securities with losses over 12 months, Fair Value, Available-for-sale	10,386,000		0
Securities with losses over 12 months, Gross Unrealized Loss, Available-for-sale	111,000		0
Total securities, Fair Value, Available-for-sale	10,386,000		10,463,000
Total securities, Gross Unrealized Loss, Available-for-sale	111,000		191,000
Obligation of State and Political Subdivisions [Member]
Available-for-sale Securities [Abstract]
Amortized Cost	50,581,000		57,925,000
Gross Unrealized Gains	2,046,000		2,296,000
Gross Unrealized Losses	54,000		243,000
Fair Value	52,573,000		59,978,000
Held-to-maturity [Abstract]
Amortized Cost	46,804,000		47,377,000
Gross Unrealized Gains	97,000		38,000
Gross Unrealized Losses	679,000		2,586,000
Fair Value	46,222,000		44,829,000
Available-for-sale, Amortized Cost [Abstract]
Amortized Cost	50,581,000		57,925,000
Available-for-sale, Fair Value [Abstract]
Fair Value	52,573,000		59,978,000
Held-to-maturity, Amortized Cost [Abstract]
Amortized Cost	46,804,000		47,377,000
Held-to-maturity, Fair Value [Abstract]
Held-to-maturity securities, Fair Value	46,222,000		44,829,000
Available-for-sale [Abstract]
Securities with losses under 12 months, Fair Value, Available-for-sale	656,000		4,256,000
Securities with losses under 12 months, Gross Unrealized Loss, Available-for-sale	5,000		243,000
Securities with losses over 12 months, Fair Value, Available-for-sale	3,726,000		0
Securities with losses over 12 months, Gross Unrealized Loss, Available-for-sale	49,000		0
Total securities, Fair Value, Available-for-sale	4,382,000		4,256,000
Total securities, Gross Unrealized Loss, Available-for-sale	54,000		243,000
Held-to-maturity [Abstract]
Securities with losses under 12 months, Fair Value, Held-to-maturity	7,816,000		42,246,000
Securities with losses under 12 months, Gross Unrealized Loss, Held-to-maturity	59,000		2,569,000
Securities with losses over 12 months, Fair Value, Held-to-maturity	29,812,000		685,000
Securities with losses over 12 months, Gross Unrealized Loss, Held-to-maturity	620,000		17,000
Total securities, Fair Value, Held-to-maturity	37,628,000		42,931,000
Total securities, Gross Unrealized Loss, Held-to-maturity	679,000		2,586,000
GSE Mortgage-Backed Securities [Member]
Available-for-sale Securities [Abstract]
Amortized Cost	114,947,000		146,129,000
Gross Unrealized Gains	3,146,000		2,029,000
Gross Unrealized Losses	621,000		2,193,000
Fair Value	117,472,000		145,965,000
Held-to-maturity [Abstract]
Amortized Cost	73,054,000		78,272,000
Gross Unrealized Gains	977,000		148,000
Gross Unrealized Losses	321,000		1,079,000
Fair Value	73,710,000		77,341,000
Available-for-sale, Amortized Cost [Abstract]
Amortized Cost	114,947,000		146,129,000
Available-for-sale, Fair Value [Abstract]
Fair Value	117,472,000		145,965,000
Held-to-maturity, Amortized Cost [Abstract]
Amortized Cost	73,054,000		78,272,000
Held-to-maturity, Fair Value [Abstract]
Held-to-maturity securities, Fair Value	73,710,000		77,341,000
Available-for-sale [Abstract]
Securities with losses under 12 months, Fair Value, Available-for-sale	3,662,000		68,028,000
Securities with losses under 12 months, Gross Unrealized Loss, Available-for-sale	13,000		2,193,000
Securities with losses over 12 months, Fair Value, Available-for-sale	40,979,000		0
Securities with losses over 12 months, Gross Unrealized Loss, Available-for-sale	608,000		0
Total securities, Fair Value, Available-for-sale	44,641,000		68,028,000
Total securities, Gross Unrealized Loss, Available-for-sale	621,000		2,193,000
Held-to-maturity [Abstract]
Securities with losses under 12 months, Fair Value, Held-to-maturity	0		31,042,000
Securities with losses under 12 months, Gross Unrealized Loss, Held-to-maturity	0		1,079,000
Securities with losses over 12 months, Fair Value, Held-to-maturity	29,908,000		0
Securities with losses over 12 months, Gross Unrealized Loss, Held-to-maturity	321,000		0
Total securities, Fair Value, Held-to-maturity	29,908,000		31,042,000
Total securities, Gross Unrealized Loss, Held-to-maturity	321,000		1,079,000
Collateralized Mortgage Obligations: Residential [Member]
Available-for-sale Securities [Abstract]
Amortized Cost	68,193,000		73,569,000
Gross Unrealized Gains	354,000		212,000
Gross Unrealized Losses	2,083,000		2,894,000
Fair Value	66,464,000		70,887,000
Held-to-maturity [Abstract]
Amortized Cost	13,515,000		14,189,000
Gross Unrealized Gains	0		0
Gross Unrealized Losses	520,000		979,000
Fair Value	12,995,000		13,210,000
Available-for-sale, Amortized Cost [Abstract]
Amortized Cost	68,193,000		73,569,000
Available-for-sale, Fair Value [Abstract]
Fair Value	66,464,000		70,887,000
Held-to-maturity, Amortized Cost [Abstract]
Amortized Cost	13,515,000		14,189,000
Held-to-maturity, Fair Value [Abstract]
Held-to-maturity securities, Fair Value	12,995,000		13,210,000
Available-for-sale [Abstract]
Securities with losses under 12 months, Fair Value, Available-for-sale	4,730,000		56,975,000
Securities with losses under 12 months, Gross Unrealized Loss, Available-for-sale	17,000		2,563,000
Securities with losses over 12 months, Fair Value, Available-for-sale	45,254,000		4,371,000
Securities with losses over 12 months, Gross Unrealized Loss, Available-for-sale	2,066,000		331,000
Total securities, Fair Value, Available-for-sale	49,984,000		61,346,000
Total securities, Gross Unrealized Loss, Available-for-sale	2,083,000		2,894,000
Held-to-maturity [Abstract]
Securities with losses under 12 months, Fair Value, Held-to-maturity	0		13,210,000
Securities with losses under 12 months, Gross Unrealized Loss, Held-to-maturity	0		979,000
Securities with losses over 12 months, Fair Value, Held-to-maturity	12,995,000		0
Securities with losses over 12 months, Gross Unrealized Loss, Held-to-maturity	520,000		0
Total securities, Fair Value, Held-to-maturity	12,995,000		13,210,000
Total securities, Gross Unrealized Loss, Held-to-maturity	520,000		979,000
Collateralized Mortgage Obligations: Commercial [Member]
Available-for-sale Securities [Abstract]
Amortized Cost	26,731,000		27,082,000
Gross Unrealized Gains	388,000		416,000
Gross Unrealized Losses	101,000		152,000
Fair Value	27,018,000		27,346,000
Held-to-maturity [Abstract]
Amortized Cost	15,554,000		15,685,000
Gross Unrealized Gains	78,000		103,000
Gross Unrealized Losses	0		0
Fair Value	15,632,000		15,788,000
Available-for-sale, Amortized Cost [Abstract]
Amortized Cost	26,731,000		27,082,000
Available-for-sale, Fair Value [Abstract]
Fair Value	27,018,000		27,346,000
Held-to-maturity, Amortized Cost [Abstract]
Amortized Cost	15,554,000		15,685,000
Held-to-maturity, Fair Value [Abstract]
Held-to-maturity securities, Fair Value	15,632,000		15,788,000
Available-for-sale [Abstract]
Securities with losses under 12 months, Fair Value, Available-for-sale	0		4,282,000
Securities with losses under 12 months, Gross Unrealized Loss, Available-for-sale	0		152,000
Securities with losses over 12 months, Fair Value, Available-for-sale	4,097,000		0
Securities with losses over 12 months, Gross Unrealized Loss, Available-for-sale	101,000		0
Total securities, Fair Value, Available-for-sale	4,097,000		4,282,000
Total securities, Gross Unrealized Loss, Available-for-sale	101,000		152,000
Other Asset-Backed Securities [Member]
Available-for-sale Securities [Abstract]
Amortized Cost	24,681,000		25,204,000
Gross Unrealized Gains	404,000		351,000
Gross Unrealized Losses	0		66,000
Fair Value	25,085,000		25,489,000
Available-for-sale, Amortized Cost [Abstract]
Amortized Cost	24,681,000		25,204,000
Available-for-sale, Fair Value [Abstract]
Fair Value	25,085,000		25,489,000
Available-for-sale [Abstract]
Securities with losses under 12 months, Fair Value, Available-for-sale			13,099,000
Securities with losses under 12 months, Gross Unrealized Loss, Available-for-sale			66,000
Securities with losses over 12 months, Fair Value, Available-for-sale			0
Securities with losses over 12 months, Gross Unrealized Loss, Available-for-sale			0
Total securities, Fair Value, Available-for-sale			13,099,000
Total securities, Gross Unrealized Loss, Available-for-sale			66,000
Collateralized Debt Obligations [Member]
Available-for-sale Securities [Abstract]
Amortized Cost	464,000		464,000
Gross Unrealized Gains	861,000		271,000
Gross Unrealized Losses	0		0
Fair Value	1,325,000		735,000
Available-for-sale, Amortized Cost [Abstract]
Amortized Cost	464,000		464,000
Available-for-sale, Fair Value [Abstract]
Fair Value	$ 1,325,000		$ 735,000

[1] Derived from audited financial statements.