Operating Segments - Net Sales by Operating Group (Details) - USD ($) $ in Thousands	12 Months Ended
	Feb. 01, 2025	Feb. 03, 2024	Jan. 28, 2023
Segment Reporting Information [Line Items]
Net sales	$ 1,516,601	$ 1,571,475	$ 1,411,528
Operating Segments | Tommy Bahama
Segment Reporting Information [Line Items]
Net sales	869,604	898,807	880,233
Operating Segments | Lilly Pulitzer
Segment Reporting Information [Line Items]
Net sales	323,917	343,499	339,266
Operating Segments | Johnny Was
Segment Reporting Information [Line Items]
Net sales	194,978	202,859	72,591
Operating Segments | Emerging Brands
Segment Reporting Information [Line Items]
Net sales	128,428	126,825	116,484
Corporate and Other
Segment Reporting Information [Line Items]
Net sales	(326)	(515)	2,954
Retail
Segment Reporting Information [Line Items]
Net sales	$ 599,706	$ 605,486	$ 552,696
Retail | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	39.00%	39.00%	39.00%
Retail | Operating Segments | Tommy Bahama | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	45.00%	45.00%	46.00%
Retail | Operating Segments | Lilly Pulitzer | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	35.00%	33.00%	33.00%
Retail | Operating Segments | Johnny Was | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	38.00%	38.00%	36.00%
Retail | Operating Segments | Emerging Brands | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	17.00%	11.00%	6.00%
Retail | Corporate and Other | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
E-commerce
Segment Reporting Information [Line Items]
Net sales	$ 519,283	$ 538,224	$ 465,446
E-commerce | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	34.00%	34.00%	33.00%
E-commerce | Operating Segments | Tommy Bahama | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	26.00%	25.00%	24.00%
E-commerce | Operating Segments | Lilly Pulitzer | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	48.00%	51.00%	51.00%
E-commerce | Operating Segments | Johnny Was | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	43.00%	41.00%	42.00%
E-commerce | Operating Segments | Emerging Brands | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	44.00%	43.00%	42.00%
E-commerce | Corporate and Other | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
Food and Beverage
Segment Reporting Information [Line Items]
Net sales	$ 116,821	$ 115,766	$ 109,225
Food and Beverage | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	8.00%	7.00%	8.00%
Food and Beverage | Operating Segments | Tommy Bahama | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	13.00%	13.00%	13.00%
Food and Beverage | Operating Segments | Lilly Pulitzer | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
Food and Beverage | Operating Segments | Johnny Was | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
Food and Beverage | Operating Segments | Emerging Brands | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
Food and Beverage | Corporate and Other | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
Wholesale
Segment Reporting Information [Line Items]
Net sales	$ 281,115	$ 311,910	$ 281,938
Wholesale | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	19.00%	20.00%	20.00%
Wholesale | Operating Segments | Tommy Bahama | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	16.00%	17.00%	17.00%
Wholesale | Operating Segments | Lilly Pulitzer | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	17.00%	16.00%	16.00%
Wholesale | Operating Segments | Johnny Was | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	19.00%	21.00%	22.00%
Wholesale | Operating Segments | Emerging Brands | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	39.00%	46.00%	52.00%
Wholesale | Corporate and Other | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
Other
Segment Reporting Information [Line Items]
Net sales	$ (324)	$ 89	$ 2,223
Other | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
Other | Operating Segments | Tommy Bahama | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
Other | Operating Segments | Lilly Pulitzer | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
Other | Operating Segments | Johnny Was | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%
Other | Operating Segments | Emerging Brands | Revenue from Contract with Customer Benchmark | Sales Channel Concentration Risk
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%