Consolidated Balance Sheets (Parenthetical) (USD $) In Thousands, except Share data, unless otherwise specified	Mar. 31, 2014	Dec. 31, 2013
Consolidated Balance Sheets [Abstract]
Total securities held to maturity, Fair value	$ 53,458	$ 40,217
Common stock, par value (in dollars per share)	$ 0.001	$ 0.001
Common stock, shares authorized	30,000,000	30,000,000
Common stock, shares issued	23,923,925	23,519,164
Common stock, shares outstanding	21,696,107	21,303,707
Common stock, unvested restricted stock	745,406	386,525
Treasury stock, shares	2,227,818	2,215,457