Operating Group Information - Sales by operating group (Details) - USD ($) $ in Thousands	3 Months Ended
	Apr. 30, 2022	May 01, 2021
Operating groups
Net sales	$ 352,581	$ 265,762
Operating Segments | Tommy Bahama
Operating groups
Net sales	228,067	156,698
Operating Segments | Lilly Pulitzer
Operating groups
Net sales	92,045	73,576
Operating Segments | Emerging Brands
Operating groups
Net sales	31,763	22,432
Operating Segments | Lanier Apparel
Operating groups
Net sales		12,019
Corporate and Other
Operating groups
Net sales	706	1,037
Retail
Operating groups
Net sales	$ 136,080	$ 91,280
Net sales (as a percent)	39.00%	34.00%
Retail | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	45.00%	42.00%
Retail | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	34.00%	35.00%
Retail | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	5.00%	3.00%
E-commerce
Operating groups
Net sales	$ 96,473	$ 74,238
Net sales (as a percent)	27.00%	28.00%
E-commerce | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	20.00%	23.00%
E-commerce | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	44.00%	42.00%
E-commerce | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	30.00%	34.00%
Restaurant
Operating groups
Net sales	$ 30,885	$ 25,208
Net sales (as a percent)	9.00%	9.00%
Restaurant | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	14.00%	16.00%
Wholesale
Operating groups
Net sales	$ 88,616	$ 74,453
Net sales (as a percent)	25.00%	28.00%
Wholesale | Operating Segments | Tommy Bahama
Operating groups
Net sales (as a percent)	21.00%	19.00%
Wholesale | Operating Segments | Lilly Pulitzer
Operating groups
Net sales (as a percent)	22.00%	23.00%
Wholesale | Operating Segments | Emerging Brands
Operating groups
Net sales (as a percent)	65.00%	63.00%
Wholesale | Operating Segments | Lanier Apparel
Operating groups
Net sales (as a percent)		100.00%
Wholesale | Corporate and Other
Operating groups
Net sales (as a percent)	43.00%	53.00%
Other
Operating groups
Net sales	$ 527	$ 583
Other | Corporate and Other
Operating groups
Net sales (as a percent)	57.00%	47.00%