Reportable Segment Information (Details) $ in Thousands	3 Months Ended		9 Months Ended
	Oct. 02, 2021 USD ($)	Sep. 26, 2020 USD ($)	Oct. 02, 2021 USD ($) segment	Sep. 26, 2020 USD ($)	Jan. 02, 2021 USD ($)
Segment Reporting Information [Line Items]
Number of reportable segments | segment			2
Net sales	$ 586,750	$ 507,063	$ 1,581,498	$ 1,393,224
Income (loss) before income taxes	26,243	38,762	73,530	29,876
Interest expense, net	1,853	1,517	5,465	5,271
Income before income taxes	24,390	37,245	68,065	24,605
Depreciation and amortization expense	20,870	19,312	62,010	57,917
Capital expenditures (including capitalized software)	15,499	11,225	47,795	32,001
Identifiable assets	1,534,366		1,534,366		$ 1,418,032
Workplace furnishings
Segment Reporting Information [Line Items]
Net sales	393,141	353,361	1,040,026	999,827
Residential building products
Segment Reporting Information [Line Items]
Net sales	193,609	153,702	541,472	393,397
Operating segments | Workplace furnishings
Segment Reporting Information [Line Items]
Net sales	393,141	353,361	1,040,026	999,827
Income (loss) before income taxes	3,893	16,826	9,578	(8,619)
Depreciation and amortization expense	11,882	11,065	35,918	33,177
Capital expenditures (including capitalized software)	6,494	6,946	24,001	18,340
Identifiable assets	832,055		832,055		762,780
Operating segments | Residential building products
Segment Reporting Information [Line Items]
Net sales	193,609	153,702	541,472	393,397
Income (loss) before income taxes	33,392	30,197	103,766	65,232
Depreciation and amortization expense	2,545	2,351	7,403	6,976
Capital expenditures (including capitalized software)	5,456	2,695	12,113	5,874
Identifiable assets	415,092		415,092		381,550
General corporate
Segment Reporting Information [Line Items]
Income (loss) before income taxes	(11,042)	(8,261)	(39,814)	(26,737)
Depreciation and amortization expense	6,443	5,896	18,689	17,764
Capital expenditures (including capitalized software)	3,549	$ 1,584	11,681	$ 7,787
Identifiable assets	$ 287,219		$ 287,219		$ 273,702