Earnings Per Common Share (Details) (USD $) In Thousands, except Per Share data, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012
Income [Abstract]
Net income before preferred stock dividends	$ 11,022	$ 4,436
Less preferred stock dividends	(482)	(508)
Net income applicable to common shareholders	10,540	3,928
Effect of Series D preferred stock	482
Net income applicable to common shareholders, diluted	$ 11,022	$ 3,928
Shares [Abstract]
Weighted average shares outstanding, basic (in shares)	21,236	21,222
Effect of dilutive stock options (in shares)	10	67
Effect of Series D preferred stock (in shares)	1,629
Weighted average shares outstanding, diluted (in shares)	22,875	21,289
Per Share Amount [Abstract]
Net income applicable to common shareholders, basic (in dollars per share)	$ 0.50	$ 0.19
Net income applicable to common shareholders, diluted (in dollars per share)	$ 0.48	$ 0.18