CONSOLIDATED STATEMENTS OF CHANGES IN STOCKHOLDERS' EQUITY - USD ($) $ in Thousands	Total	Preferred Stock	Preferred Stock Preferred Stock	Common Stock	Common Stock Common Stock	Additional Paid-in- Capital	Treasury Stock	Retained Earnings	Accumulated Other Comprehensive Income (Loss)
Beginning Balance (in shares) at Dec. 31, 2018				26,949,936			104,063
Beginning Balance at Dec. 31, 2018	$ 636,607			$ 271		$ 469,341	$ (2,288)	$ 170,486	$ (1,203)
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Issuance of restricted stock awards (in shares)				8,063
Stock based compensation	911					911
Forfeiture of restricted stock awards (in shares)				(1,276)			1,276
Forfeiture of restricted stock awards						40	$ (40)
Purchase of treasury stock (in shares)				(247,312)			247,312
Purchase of treasury stock	(7,553)						$ (7,553)
Net income (loss)	14,788							14,788
Other comprehensive income (loss)	1,463								1,463
Ending Balance (in shares) at Mar. 31, 2019				26,709,411			352,651
Ending Balance at Mar. 31, 2019	646,216			$ 271		470,292	$ (9,881)	185,274	260
Beginning Balance (in shares) at Dec. 31, 2018				26,949,936			104,063
Beginning Balance at Dec. 31, 2018	636,607			$ 271		469,341	$ (2,288)	170,486	(1,203)
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income (loss)	41,835
Other comprehensive income (loss)	2,567
Ending Balance (in shares) at Sep. 30, 2019				25,357,985			1,805,448
Ending Balance at Sep. 30, 2019	633,693			$ 272		472,368	$ (52,632)	212,321	1,364
Beginning Balance (in shares) at Mar. 31, 2019				26,709,411			352,651
Beginning Balance at Mar. 31, 2019	646,216			$ 271		470,292	$ (9,881)	185,274	260
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Issuance of restricted stock awards (in shares)				85,503
Stock based compensation	825					825
Forfeiture of restricted stock awards (in shares)				(920)			920
Forfeiture of restricted stock awards						28	$ (28)
Stock option exercises, net (in shares)				368
Purchase of treasury stock (in shares)				(596,054)			596,054
Purchase of treasury stock	(17,559)						$ (17,559)
Net income (loss)	12,730							12,730
Other comprehensive income (loss)	1,150								1,150
Ending Balance (in shares) at Jun. 30, 2019				26,198,308			949,625
Ending Balance at Jun. 30, 2019	643,362			$ 271		471,145	$ (27,468)	198,004	1,410
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Issuance of restricted stock awards (in shares)				10,847
Issuance of restricted stock awards				$ 1		(1)
Stock based compensation	1,058					1,058
Forfeiture of restricted stock awards (in shares)				(5,730)			5,730
Forfeiture of restricted stock awards						166	$ (166)
Stock option exercises, net (in shares)				4,653
Purchase of treasury stock (in shares)				(850,093)			850,093
Purchase of treasury stock	(24,998)						$ (24,998)
Net income (loss)	14,317							14,317
Other comprehensive income (loss)	(46)								(46)
Ending Balance (in shares) at Sep. 30, 2019				25,357,985			1,805,448
Ending Balance at Sep. 30, 2019	633,693			$ 272		472,368	$ (52,632)	212,321	1,364
Beginning Balance (in shares) at Dec. 31, 2019				24,964,961			2,198,681
Beginning Balance at Dec. 31, 2019	636,590			$ 271		473,251	$ (67,068)	229,030	1,106
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Impact of adoption of ASU 2016-13 | ASU 2016-13	(1,771)							(1,771)
Issuance of restricted stock awards (in shares)				8,079
Issuance of restricted stock awards				$ 1		(1)
Stock based compensation	1,168					1,168
Forfeiture of restricted stock awards (in shares)				(601)			601
Forfeiture of restricted stock awards						23	$ (23)
Purchase of treasury stock (in shares)				(871,319)			871,319
Purchase of treasury stock	(35,586)						$ (35,586)
Net income (loss)	(4,450)							(4,450)
Other comprehensive income (loss)	(6,604)								(6,604)
Ending Balance (in shares) at Mar. 31, 2020				24,101,120			3,070,601
Ending Balance at Mar. 31, 2020	589,347			$ 272		474,441	$ (102,677)	222,809	(5,498)
Beginning Balance (in shares) at Dec. 31, 2019				24,964,961			2,198,681
Beginning Balance at Dec. 31, 2019	636,590			$ 271		473,251	$ (67,068)	229,030	1,106
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income (loss)	31,894
Other comprehensive income (loss)	4,051
Ending Balance (in shares) at Sep. 30, 2020				24,851,601			3,081,070
Ending Balance at Sep. 30, 2020	693,842	$ 45,000		$ 279		488,094	$ (102,942)	258,254	5,157
Beginning Balance (in shares) at Mar. 31, 2020				24,101,120			3,070,601
Beginning Balance at Mar. 31, 2020	589,347			$ 272		474,441	$ (102,677)	222,809	(5,498)
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Issuance of restricted stock awards (in shares)				110,035
Issuance of restricted stock awards				$ 1		(1)
Issuance of stock	42,364		$ 45,000			(2,636)
Stock based compensation	966					966
Forfeiture of restricted stock awards (in shares)				(1,033)			1,033
Forfeiture of restricted stock awards						25	$ (25)
Purchase of treasury stock (in shares)				(7,436)			7,436
Purchase of treasury stock	(186)						$ (186)
Net income (loss)	13,440							13,440
Other comprehensive income (loss)	10,940								10,940
Ending Balance (in shares) at Jun. 30, 2020				24,202,686			3,079,070
Ending Balance at Jun. 30, 2020	656,871	45,000		$ 273		472,795	$ (102,888)	236,249	5,442
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Issuance of restricted stock awards (in shares)				20,303
Issuance of restricted stock awards				$ (1)		1
Issuance of stock (in shares)					630,268
Issuance of stock	13,942				$ 7	13,935
Stock based compensation	1,309					1,309
Forfeiture of restricted stock awards (in shares)				(2,000)			2,000
Forfeiture of restricted stock awards						54	$ (54)
Stock option exercises, net (in shares)				344
Preferred stock dividends	(899)							(899)
Net income (loss)	22,904							22,904
Other comprehensive income (loss)	(285)								(285)
Ending Balance (in shares) at Sep. 30, 2020				24,851,601			3,081,070
Ending Balance at Sep. 30, 2020	$ 693,842	$ 45,000		$ 279		$ 488,094	$ (102,942)	$ 258,254	$ 5,157