Reportable Segment Information - Business Segment Information (Details) $ in Thousands	12 Months Ended
	Jan. 01, 2022 USD ($) segment	Jan. 02, 2021 USD ($)	Dec. 28, 2019 USD ($)
Segment Reporting Information [Line Items]
Number of reportable segments | segment	2
Net sales	$ 2,184,408	$ 1,955,363	$ 2,246,947
Operating income	85,420	61,375	151,342
Interest expense, net	7,153	6,990	8,628
Total	78,267	54,385	142,714
Depreciation and Amortization Expense:	83,146	77,683	77,427
Capital Expenditures (including capitalized software):	66,548	41,802	66,885
Identifiable Assets:	1,497,897	1,418,032	1,452,512
Workplace furnishings
Segment Reporting Information [Line Items]
Net sales	1,433,985	1,365,711	1,697,186
Residential building products
Segment Reporting Information [Line Items]
Net sales	750,423	589,652	549,761
Operating | Workplace furnishings
Segment Reporting Information [Line Items]
Net sales	1,433,985	1,365,711	1,697,186
Operating profit	(539)	(4,972)	103,894
Depreciation and Amortization Expense:	47,838	44,615	44,887
Capital Expenditures (including capitalized software):	34,809	24,188	41,137
Identifiable Assets:	808,963	762,780	874,913
Operating | Residential building products
Segment Reporting Information [Line Items]
Net sales	750,423	589,652	549,761
Operating profit	141,871	109,321	94,329
Depreciation and Amortization Expense:	10,001	9,386	8,884
Capital Expenditures (including capitalized software):	16,091	8,213	12,225
Identifiable Assets:	479,462	381,550	364,653
General corporate
Segment Reporting Information [Line Items]
General corporate	(55,912)	(42,974)	(46,881)
Depreciation and Amortization Expense:	25,307	23,682	23,656
Capital Expenditures (including capitalized software):	15,648	9,401	13,523
Identifiable Assets:	$ 209,472	$ 273,702	$ 212,946