Intangible Assets and Goodwill - By Operating Group (Details) - USD ($) $ in Thousands	12 Months Ended
	Feb. 01, 2025	Feb. 03, 2024	Jan. 28, 2023
Intangible Assets Net Excluding Goodwill [Roll Forward]
Balance at the beginning of the period	$ 262,101	$ 283,845	$ 155,307
Acquisition	7,814	4,899	134,640
Impairment	$ 0	(11,900)	0
Impairment, Intangible Asset, Statement of Income or Comprehensive Income [Extensible Enumeration]	Impairment of goodwill, intangible assets and equity method investments
Amortization	$ (12,000)	(14,743)	(6,102)
Balance at the end of the period	257,915	262,101	283,845
Operating Segments | Tommy Bahama
Intangible Assets Net Excluding Goodwill [Roll Forward]
Balance at the beginning of the period	110,700	110,700	110,700
Balance at the end of the period	110,700	110,700	110,700
Operating Segments | Lilly Pulitzer
Intangible Assets Net Excluding Goodwill [Roll Forward]
Balance at the beginning of the period	27,632	27,859	28,097
Acquisition	7,814
Amortization	(244)	(227)	(238)
Balance at the end of the period	35,202	27,632	27,859
Operating Segments | Johnny Was
Intangible Assets Net Excluding Goodwill [Roll Forward]
Balance at the beginning of the period	103,694	129,446	0
Acquisition			134,640
Impairment		(11,900)
Amortization	(10,870)	(13,852)	(5,194)
Balance at the end of the period	92,824	103,694	129,446
Operating Segments | Emerging Brands
Intangible Assets Net Excluding Goodwill [Roll Forward]
Balance at the beginning of the period	20,075	15,840	16,510
Acquisition		4,899
Amortization	(886)	(664)	(670)
Balance at the end of the period	19,189	20,075	15,840
Corporate and Other
Intangible Assets Net Excluding Goodwill [Roll Forward]
Balance at the beginning of the period	0	0	0
Balance at the end of the period	$ 0	$ 0	$ 0