Goodwill and Other Intangible Assets (Goodwill) (Details) - USD ($) $ in Thousands	12 Months Ended
	Jan. 02, 2021	Dec. 28, 2019
Goodwill [Roll Forward]
Goodwill, gross beginning balance	$ 315,339	$ 315,307
Accumulated impairment losses, beginning balance	(44,519)	(44,519)
Goodwill, net beginning balance	270,820	270,788
Foreign currency translation adjustment		32
Goodwill acquired during the year	50,114
Impairment losses	(28,500)
Goodwill, gross ending balance	365,453	315,339
Accumulated impairment losses, ending balance	(73,019)	(44,519)
Goodwill, net ending balance	292,434	270,820
Workplace Furnishings
Goodwill [Roll Forward]
Goodwill, gross beginning balance	128,677	128,645
Accumulated impairment losses, beginning balance	(44,376)	(44,376)
Goodwill, net beginning balance	84,301	84,269
Foreign currency translation adjustment		32
Goodwill acquired during the year	39,800
Impairment losses	(28,500)
Goodwill, gross ending balance	168,477	128,677
Accumulated impairment losses, ending balance	(72,876)	(44,376)
Goodwill, net ending balance	95,601	84,301
Residential Building Products
Goodwill [Roll Forward]
Goodwill, gross beginning balance	186,662	186,662
Accumulated impairment losses, beginning balance	(143)	(143)
Goodwill, net beginning balance	186,519	186,519
Foreign currency translation adjustment		0
Goodwill acquired during the year	10,314
Impairment losses	0
Goodwill, gross ending balance	196,976	186,662
Accumulated impairment losses, ending balance	(143)	(143)
Goodwill, net ending balance	$ 196,833	$ 186,519