Earnings (Loss) Per Share - Computation of Basic and Diluted Net Income per Share (Details) - USD ($) $ / shares in Units, $ in Thousands	12 Months Ended
	Jan. 02, 2022	Jan. 03, 2021	Dec. 29, 2019
Basic and diluted EPS:
Net income (loss)	$ 10,370	$ (10,211)	$ (84,386)
Less: income allocated to participating securities	345	0	0
Net income (loss) available to common stockholders	$ 10,025	$ (10,211)	$ (84,386)
Weighted average common shares—basic	25,356,339	25,341,415	26,500,356
Restricted stock units (in shares)	0	0	0
Weighted average common shares—diluted	25,356,339	25,341,415	26,500,356
Earnings (loss) per common share—basic (usd per share)	$ 0.40	$ (0.40)	$ (3.18)
Earnings (loss) per common share—diluted (usd per share)	$ 0.40	$ (0.40)	$ (3.18)
Loss from continuing operations	$ (8,085)	$ (3,386)	$ (1,995)
Income (loss) from discontinued operations, net of tax	$ 18,455	$ (6,825)	$ (82,391)
Continuing operations – basic	$ (0.31)	$ (0.13)	$ (0.07)
Discontinued operations – basic	0.71	(0.27)	(3.11)
Continuing operations – diluted	(0.31)	(0.13)	(0.07)
Discontinued operations – diluted	$ 0.71	$ (0.27)	$ (3.11)