Consolidated Statements of Shareholders' Equity Statement - USD ($) $ in Thousands	Total	Preferred Stock	Preferred Stock Including Additional Paid in Capital [Member]	Common Stock	Additional Paid-in Capital	Accumulated Other Comprehensive (Loss) Income	Accumulated Deficit
Balance, Preferred stock, shares outstanding at Dec. 31, 2013		4,550,000
Balance, Common stock, shares outstanding at Dec. 31, 2013				54,310,484
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Stock Issued During Period, Shares, New Issues				16,753
Restricted stock granted, shares				471,210
Adjustments for tax withholding on share-based compensation, shares				(59,336)
Balance, Preferred stock, shares outstanding at Dec. 31, 2014		4,550,000
Balance, Common stock, shares outstanding at Dec. 31, 2014				54,739,111
Balance at Dec. 31, 2013	$ 585,876		$ 109,658	$ 543	$ 761,550	$ (33,816)	$ (252,059)
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Stock issuance	252			1	251
Restricted stock granted, value, net of amortization	2,719			4	2,715
Adjustments for tax withholding on share-based compensation, value	(507)			(1)	(506)
Stock issuance costs	(75)				(75)
Net income	27,806						27,806
Dividends on preferred stock	(9,176)						(9,176)
Dividends on common stock	(54,725)						(54,725)
Other comprehensive income (loss)	55,132					55,132
Balance at Dec. 31, 2014	$ 607,302		109,658	$ 547	763,935	21,316	(288,154)
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Stock Issued During Period, Shares, New Issues				22,607
Restricted stock granted, shares				263,829
Adjustments for tax withholding on share-based compensation, shares				(67,296)
Common stock repurchased, shares				(5,910,916)
Balance, Preferred stock, shares outstanding at Dec. 31, 2015	4,550,000	4,550,000
Balance, Common stock, shares outstanding at Dec. 31, 2015	49,047,335			49,047,335
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Stock issuance	$ 166			$ 0	166
Restricted stock granted, value, net of amortization	2,965			3	2,962
Adjustments for tax withholding on share-based compensation, value	(557)			(1)	(556)
Stock issuance costs	(37)				(37)
Common stock repurchased, value	(41,171)			(59)	(41,112)
Net income	16,544						16,544
Dividends on preferred stock	(9,176)						(9,176)
Dividends on common stock	(49,927)						(49,927)
Other comprehensive income (loss)	(34,084)					(34,084)
Balance at Dec. 31, 2015	$ 492,025		109,658	$ 490	725,358	(12,768)	(330,713)
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Stock Issued During Period, Shares, New Issues		21,937		20,582
Restricted stock granted, shares				214,878
Adjustments for tax withholding on share-based compensation, shares				(80,888)
Common stock repurchased, shares				(48,444)
Balance, Preferred stock, shares outstanding at Dec. 31, 2016	4,571,937	4,571,937
Balance, Common stock, shares outstanding at Dec. 31, 2016	49,153,463			49,153,463
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Stock issuance	$ 685		548	$ 1	136
Restricted stock granted, value, net of amortization	2,709			2	2,707
Adjustments for tax withholding on share-based compensation, value	(485)			(1)	(484)
Stock issuance costs	(239)		(201)		(38)
Common stock repurchased, value	(310)			0	(310)
Net income	43,099						43,099
Dividends on preferred stock	(9,185)						(9,185)
Dividends on common stock	(41,274)						(41,274)
Other comprehensive income (loss)	(19,841)					(19,841)
Balance at Dec. 31, 2016	$ 467,184		$ 110,005	$ 492	$ 727,369	$ (32,609)	$ (338,073)