Shareholders' Equity - Narrative (Details)	12 Months Ended
	Jan. 02, 2022 USD ($) $ / shares shares	Jan. 03, 2021 USD ($) $ / shares shares	Dec. 29, 2019 USD ($) $ / shares shares	May 22, 2020 shares	Jun. 30, 2017 USD ($)	May 31, 2015 shares
Shareholders' Equity [Line Items]
Common stock, shares authorized (in shares) | shares	120,000,000	120,000,000
Common stock, par value (in dollars per share) | $ / shares	$ 0.10	$ 0.10
Common stock, cash dividends declared (in dollars per share) | $ / shares	0.04	0.095	$ 0.26
Common stock, cash dividends paid (in dollars per share) | $ / shares	$ 0.04	$ 0.095	$ 0.26
Stock based compensation rate at which stock options exercisable (percentage)	100.00%
Number of shares authorized for issuance or transfer (in shares) | shares				3,700,000		5,161,020
Number of authorized stock reduced by issuance of other than stock option award						1.33
Outstanding at end of year (in shares) | shares	0	0
Exercisable at end of year (in shares) | shares	0	0
Stock Options
Shareholders' Equity [Line Items]
Stock compensation expense (benefit) | $	$ 0	$ 0	$ 0
Stock Options | Minimum
Shareholders' Equity [Line Items]
Vesting period (in years)	1 year
Expiration period (in years)	3 years
Stock Options | Maximum
Shareholders' Equity [Line Items]
Vesting period (in years)	5 years
Expiration period (in years)	10 years
Restricted Stock
Shareholders' Equity [Line Items]
Stock compensation expense (benefit) | $	$ 3,800,000	$ 1,300,000	$ 3,300,000
Stock awards granted (in shares) | shares	428,400	308,100	223,500
Stock awards granted, weighted average grant date fair value (in dollars per share) | $ / shares	$ 14.26	$ 13.08	$ 17.54
Unrecognized compensation cost related to unvested restricted stock | $	$ 5,100,000
Restricted Stock | Minimum
Shareholders' Equity [Line Items]
Vesting period (in years)	1 year
Restricted Stock | Maximum
Shareholders' Equity [Line Items]
Vesting period (in years)	3 years
Performance Shares
Shareholders' Equity [Line Items]
Stock compensation expense (benefit) | $	$ 1,700,000	$ (1,800,000)	$ 5,400,000
Stock awards granted (in shares) | shares	375,800
Stock awards granted, weighted average grant date fair value (in dollars per share) | $ / shares	$ 13.94
Number of shares that may be issued in settlement of the performance shares to the award recipient, upper limit (percentage)	200.00%
Unrecognized compensation expense related to unvested performance share awards | $	$ 8,700,000
Performance Shares | Minimum
Shareholders' Equity [Line Items]
Vesting period (in years)	1 year
Performance Shares | Maximum
Shareholders' Equity [Line Items]
Vesting period (in years)	3 years
Restricted Stock and Performance Shares
Shareholders' Equity [Line Items]
Compensation expense, tax benefit | $	$ 700,000	$ 600,000	$ 1,400,000
Common Stock
Shareholders' Equity [Line Items]
Stock repurchase program, authorized amount to be repurchased | $					$ 100,000,000
Stock repurchased and retired (in shares) | shares			1,556,000
Weighted average purchase price (in dollars per share) | $ / shares			$ 16.13