Consolidated Statements of Changes in Stockholders' Equity - USD ($) $ in Thousands	Preferred Stock [Member] Series E Preferred Stock [Member]	Preferred Stock [Member] Series F Preferred Stock [Member]	Common Stock [Member] Voting Common Stock [Member]	Common Stock [Member] Nonvoting Common Stock [Member]	Common Stock [Member]	Additional Paid-in Capital [Member]	Retained Earnings [Member]	AOCI Attributable to Parent [Member]	Total
Balances (in shares) at Dec. 31, 2016	6,198	4,304	4,632,933	1,591,600	6,224,533
Balances at Dec. 31, 2016	$ 1,644	$ 1,127			$ 125,729	$ 24,097	$ (113,561)	$ (6,303)	$ 32,733
Stock issued for share-based awards, net of withholdings to satisfy employee tax obligations upon award (in shares)			37,865		37,865
Stock issued for share-based awards, net of withholdings to satisfy employee tax obligations upon award
Forfeited unvested stock (in shares)			(1,316)		(1,316)
Forfeited unvested stock
Reverse stock split rounding shares (in shares)			(1,218)		(1,218)
Stock-based compensation expense						400			400
Net income							38,453		38,453
Net change in accumulated other comprehensive loss, net of taxes								1,087	1,087
Non-voting shares converted to voting (in shares)			1,371,600	(1,371,600)
Balances (in shares) at Dec. 31, 2017	6,198	4,304	6,039,864	220,000	6,259,864
Balances at Dec. 31, 2017	$ 1,644	$ 1,127			$ 125,729	24,497	(75,108)	(5,216)	72,673
Stock issued for share-based awards, net of withholdings to satisfy employee tax obligations upon award (in shares)			52,856		52,856
Stock issued for share-based awards, net of withholdings to satisfy employee tax obligations upon award
Stock-based compensation expense						524			524
Net income							8,794		8,794
Net change in accumulated other comprehensive loss, net of taxes								(1,299)	(1,299)
Issuance of stock (in shares)			150,000	1,000,000	1,150,000
Issuance of stock					$ 14,910				14,910
Redemption and retirement of preferred shares (in shares)	(6,198)	(4,304)
Redemption and retirement of preferred shares	$ (1,644)	$ (1,127)				(734)			(3,505)
Reclassification of disproportionate tax effect due to change in federal tax rate							113	(113)
Balances (in shares) at Dec. 31, 2018			6,242,720	1,220,000	7,462,720
Balances at Dec. 31, 2018					$ 140,639	24,287	(66,201)	(6,628)	92,097
Stock issued for share-based awards, net of withholdings to satisfy employee tax obligations upon award (in shares)			13,503		13,503
Stock issued for share-based awards, net of withholdings to satisfy employee tax obligations upon award						(314)			(314)
Forfeited unvested stock (in shares)			(4,248)		(4,248)
Forfeited unvested stock
Stock-based compensation expense						535			535
Net income							10,518		10,518
Net change in accumulated other comprehensive loss, net of taxes								2,914	2,914
Balances (in shares) at Dec. 31, 2019			6,251,975	1,220,000	7,471,975
Balances at Dec. 31, 2019					$ 140,639	$ 24,508	$ (55,683)	$ (3,714)	$ 105,750