Operating Groups - Assets (Details) - USD ($) $ in Thousands	3 Months Ended	12 Months Ended
	May 02, 2020	Jan. 30, 2021	Feb. 01, 2020	Feb. 02, 2019
Operating groups
Total Assets		$ 865,634	$ 1,033,369
Impairment of goodwill and intangible assets		60,452
Corporate and Other
Operating groups
Total Assets		76,705	26,385
Tommy Bahama | Operating Segments
Operating groups
Total Assets		569,854	668,197
Lilly Pulitzer | Operating Segments
Operating groups
Total Assets		176,467	199,913
Southern Tide
Operating groups
Impairment of goodwill and intangible assets	$ 60,000	60,000	0	$ 0
Southern Tide | Operating Segments
Operating groups
Total Assets		31,641	99,667
Lanier Apparel | Operating Segments
Operating groups
Total Assets		$ 10,967	$ 39,207