Intangible Assets and Goodwill - By operating group (Details) - USD ($) $ in Thousands	12 Months Ended
	Feb. 03, 2024	Jan. 28, 2023	Jan. 29, 2022
Changes in carrying amount of intangible assets
Balance at the beginning of the period	$ 283,845	$ 155,307	$ 156,187
Acquisition	4,899	134,640
Impairment	(11,900)
Amortization	(14,743)	(6,102)	(880)
Balance at the end of the period	$ 262,101	$ 283,845	$ 155,307
Impairment, Intangible Asset, (Excluding Goodwill), Statement of Income or Comprehensive Income	Impairment of goodwill, intangible assets and equity method investments	Impairment of goodwill, intangible assets and equity method investments	Impairment of goodwill, intangible assets and equity method investments
Operating Segments | Tommy Bahama
Changes in carrying amount of intangible assets
Balance at the beginning of the period	$ 110,700	$ 110,700	$ 110,700
Balance at the end of the period	110,700	110,700	110,700
Operating Segments | Lilly Pulitzer
Changes in carrying amount of intangible assets
Balance at the beginning of the period	27,859	28,097	28,317
Amortization	(227)	(238)	(220)
Balance at the end of the period	27,632	27,859	28,097
Operating Segments | Johnny Was
Changes in carrying amount of intangible assets
Balance at the beginning of the period	129,446
Acquisition		134,640
Impairment	(11,900)
Amortization	(13,852)	(5,194)
Balance at the end of the period	103,694	129,446
Operating Segments | Emerging Brands
Changes in carrying amount of intangible assets
Balance at the beginning of the period	15,840	16,510	17,170
Acquisition	4,899
Amortization	(664)	(670)	(660)
Balance at the end of the period	$ 20,075	$ 15,840	$ 16,510