Consolidated Statements of Changes in Stockholders' Equity (USD $) In Thousands, except Share data	Total	Preferred Stock [Member]	Common Stock [Member]	Capital Surplus [Member]	Retained Earnings [Member]	Accumulated Other Comprehensive Income, Net of Tax [Member]	Accumulated Other Comprehensive Income, Net of Tax [Member] Unrealized Gains on Securities [Member]	Accumulated Other Comprehensive Income, Net of Tax [Member] Interest Rate Floor [Member]	Accumulated Other Comprehensive Income, Net of Tax [Member] Interest Rate Swap [Member]	Treasury Stock [Member]
Balance at beginning of period at Dec. 31, 2010		$ 50,121	$ 24,983	$ 165,930	$ 37,000		$ 1,813	$ 559	$ 3,832	$ (10,831)
Balance at beginning of period, shares at Dec. 31, 2010		52,000	24,982,911							1,336,174
Net income	21,093				21,093
Change during period	1,092						4,627	(559)	(2,976)
Dividends on preferred shares					(2,635)
Issuance of restricted shares			135	(135)
Stock-based compensation				785
Issuance of restricted shares, shares			135,075
Cancellation of restricted shares			(34)	34
Accretion of fair value of warrant		606			(606)
Cancellation of restricted shares, shares			(34,150)
Proceeds from exercise of stock options			3	25
Proceeds from exercise of stock options, shares			3,632
Balance at end of period at Dec. 31, 2011	293,770	50,727	25,087	166,639	54,852	7,296	6,440		856	(10,831)
Balance at end of period, shares at Dec. 31, 2011		52,000	25,087,468							1,336,174
Net income	14,435				14,435
Change during period	(689)						190		(879)
Repurchase of preferred stock		(24,000)
Purchase of treasury shares										(235)
Dividends on preferred shares					(2,642)
Repurchase of warrant				(2,670)
Repurchase of preferred stock, shares		(24,000)
Purchase of treasury shares, shares										18,876
Issuance of restricted shares			67	(67)
Stock-based compensation				1,044
Issuance of restricted shares, shares			67,450
Cancellation of restricted shares				1
Accretion of fair value of warrant		935			(935)
Cancellation of restricted shares, shares			(500)
Proceeds from exercise of stock options			1	2
Proceeds from exercise of stock options, shares			400
Balance at end of period at Dec. 31, 2012	279,017	27,662	25,155	164,949	65,710	6,607	6,630		(23)	(11,066)
Balance at end of period, shares at Dec. 31, 2012		28,000	25,154,818							1,355,050
Net income	20,018				20,018
Change during period	(6,901)						(8,321)		1,420
Issuance of common stock			1,169	23,460
Purchase of treasury shares										(116)
Dividends on preferred shares					(1,399)
Issuance of common stock, shares			1,168,918
Purchase of treasury shares, shares										8,292
Issuance of restricted shares			108	(108)
Stock-based compensation				1,041
Issuance of restricted shares, shares			108,400
Cancellation of restricted shares			(4)	4
Accretion of fair value of warrant		338			(338)
Cancellation of restricted shares, shares			(4,000)
Proceeds from exercise of stock options			34	376
Proceeds from exercise of stock options, shares			33,633
Balance at end of period at Dec. 31, 2013	$ 316,699	$ 28,000	$ 26,462	$ 189,722	$ 83,991	$ (294)	$ (1,691)		$ 1,397	$ (11,182)
Balance at end of period, shares at Dec. 31, 2013		28,000	26,461,769							1,363,342