Condensed Consolidated Statements of Shareholders' Equity (Unaudited) (USD $) In Thousands, except Share data, unless otherwise specified		Total		Common Stock		Preferred Stock [Member]	Warrants	Surplus	Accumulated Deficit	Accumulated Other Comprehensive Income (Loss)
Balance at Dec. 31, 2012		$ 170,794		$ 43,152		$ 27,942	$ 3,581	$ 156,176	$ (64,241)	$ 4,184
Balance, shares at Dec. 31, 2012	[1]			43,151,652
Repurchase and cancellation of Warrants		(20)					(1,731)	1,711
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income		9,458							9,458
1-for-3 reverse stock split, shares	[1]			(28,767,902)
1-for-3 reverse stock split		0		(28,768)				28,768
Repurchase of fractional shares, shares	[1]	(3,006)
Repurchase of fractional shares		(39)		(3)				(36)
Stock options exercised, shares		0
Restricted stock issued (forfeited), shares	[1]			3,242
Restricted stock issued (forfeited)		0		3				(3)
Restricted stock surrendered (in lieu of taxes)		0
Discount accretion on preferred stock		0				331			(331)
Share based compensation:
stock options		15						15
restricted stock		238						238
Preferred stock dividends		(704)							(704)
Other comprehensive income		(5,126)								(5,126)
Balance at Jun. 30, 2013		174,616		14,384		28,273	1,850	186,869	(55,818)	(942)
Balance, shares at Jun. 30, 2013	[1]			14,383,986
Balance at Dec. 31, 2013		184,470	[2]	14,384		28,405	1,850	187,118	(47,292)	5
Balance, shares at Dec. 31, 2013	[1]			14,383,986
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income		8,296							8,296
Stock options exercised, shares		555		555	[1]
Stock options exercised		6		1				5
Restricted stock issued (forfeited), shares	[1]			(367)
Restricted stock issued (forfeited)		0		(1)				1
Restricted stock surrendered (in lieu of taxes), shares	[1]			(4,047)
Restricted stock surrendered (in lieu of taxes)		(79)		(4)				(75)
Share based compensation:
stock options		7						7
restricted stock		208						208
Preferred stock dividends		(1,167)							(1,167)
Other comprehensive income		2,017								2,017
Balance at Jun. 30, 2014		$ 193,758		$ 14,380		$ 28,405	$ 1,850	$ 187,264	$ (40,163)	$ 2,022
Balance, shares at Jun. 30, 2014	[1]			14,380,127

[1] Shares outstanding at June 30, 2014 include 13,725,130 shares of voting common stock and 654,997 shares of non-voting common stock.

[2] Derived from audited consolidated financial statements