Operating Groups - Sales by operating group (Details) - USD ($) $ in Thousands	12 Months Ended
	Feb. 03, 2024	Jan. 28, 2023	Jan. 29, 2022
Operating groups
Net sales	$ 1,571,475	$ 1,411,528	$ 1,142,079
Operating Segments | Tommy Bahama
Operating groups
Net sales	898,807	880,233	724,305
Operating Segments | Lilly Pulitzer
Operating groups
Net sales	343,499	339,266	298,995
Operating Segments | Johnny Was
Operating groups
Net sales	202,859	72,591
Operating Segments | Emerging Brands
Operating groups
Net sales	126,825	116,484	90,053
Operating Segments | Lanier Apparel
Operating groups
Net sales			24,858
Corporate and Other
Operating groups
Net sales	(515)	2,954	3,868
Retail
Operating groups
Net sales	$ 605,486	$ 552,696	$ 443,015
Net sales (as a percent)	39.00%	39.00%	39.00%
Retail | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	45.00%	46.00%	47.00%
Retail | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	33.00%	33.00%	34.00%
Retail | Operating Segments | Johnny Was
Operating groups
Net sales (as a percent)	38.00%	36.00%
Retail | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	11.00%	6.00%	5.00%
E-commerce
Operating groups
Net sales	$ 538,224	$ 465,446	$ 369,300
Net sales (as a percent)	34.00%	33.00%	32.00%
E-commerce | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	25.00%	24.00%	25.00%
E-commerce | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	51.00%	51.00%	50.00%
E-commerce | Operating Segments | Johnny Was
Operating groups
Net sales (as a percent)	41.00%	42.00%
E-commerce | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	43.00%	42.00%	39.00%
Food & Beverage
Operating groups
Net sales	$ 115,766	$ 109,225	$ 96,244
Net sales (as a percent)	7.00%	8.00%	8.00%
Food & Beverage | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	13.00%	13.00%	13.00%
Wholesale
Operating groups
Net sales	$ 311,910	$ 281,938	$ 231,536
Net sales (as a percent)	20.00%	20.00%	20.00%
Wholesale | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	17.00%	17.00%	15.00%
Wholesale | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	16.00%	16.00%	16.00%
Wholesale | Operating Segments | Johnny Was
Operating groups
Net sales (as a percent)	21.00%	22.00%
Wholesale | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	46.00%	52.00%	56.00%
Wholesale | Operating Segments | Lanier Apparel
Operating groups
Net sales (as a percent)			100.00%
Wholesale | Corporate and Other
Operating groups
Net sales (as a percent)			61.00%
Other
Operating groups
Net sales	$ 89	$ 2,223	$ 1,984
Other | Corporate and Other
Operating groups
Net sales (as a percent)			39.00%