Operating Group Information - Net Sales by Distribution Channel (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Aug. 03, 2024	Jul. 29, 2023	Aug. 03, 2024	Jul. 29, 2023
Segment Reporting Information [Line Items]
Net sales	$ 419,886	$ 420,319	$ 818,070	$ 840,416
Operating Segments | Tommy Bahama
Segment Reporting Information [Line Items]
Net sales	245,079	245,443	470,696	484,878
Operating Segments | Lilly Pulitzer
Segment Reporting Information [Line Items]
Net sales	91,689	91,349	180,110	188,799
Operating Segments | Johnny Was
Segment Reporting Information [Line Items]
Net sales	50,280	52,023	101,492	101,514
Operating Segments | Emerging Brands
Segment Reporting Information [Line Items]
Net sales	32,929	31,580	65,931	65,571
Corporate and Other
Segment Reporting Information [Line Items]
Net sales	(91)	(76)	(159)	(346)
Retail
Segment Reporting Information [Line Items]
Net sales	$ 172,938	$ 170,137	$ 328,693	$ 327,742
Retail | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	41.00%	41.00%	40.00%	39.00%
Retail | Operating Segments | Tommy Bahama | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	45.00%	46.00%	45.00%	45.00%
Retail | Operating Segments | Lilly Pulitzer | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	39.00%	36.00%	37.00%	35.00%
Retail | Operating Segments | Johnny Was | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	40.00%	38.00%	39.00%	37.00%
Retail | Operating Segments | Emerging Brands | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	20.00%	12.00%	17.00%	10.00%
Retail | Corporate and Other | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
E-commerce
Segment Reporting Information [Line Items]
Net sales	$ 153,035	$ 152,264	$ 272,751	$ 278,028
E-commerce | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	36.00%	36.00%	33.00%	33.00%
E-commerce | Operating Segments | Tommy Bahama | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	29.00%	28.00%	25.00%	24.00%
E-commerce | Operating Segments | Lilly Pulitzer | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	44.00%	50.00%	45.00%	49.00%
E-commerce | Operating Segments | Johnny Was | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	45.00%	43.00%	42.00%	40.00%
E-commerce | Operating Segments | Emerging Brands | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	53.00%	48.00%	45.00%	42.00%
E-commerce | Corporate and Other | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Food & Beverage
Segment Reporting Information [Line Items]
Net sales	$ 29,052	$ 29,503	$ 63,769	$ 61,535
Food & Beverage | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	7.00%	7.00%	8.00%	7.00%
Food & Beverage | Operating Segments | Tommy Bahama | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	12.00%	12.00%	14.00%	13.00%
Food & Beverage | Operating Segments | Lilly Pulitzer | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Food & Beverage | Operating Segments | Johnny Was | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Food & Beverage | Operating Segments | Emerging Brands | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Food & Beverage | Corporate and Other | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Wholesale
Segment Reporting Information [Line Items]
Net sales	$ 64,952	$ 68,312	$ 153,015	$ 173,141
Wholesale | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	16.00%	16.00%	19.00%	21.00%
Wholesale | Operating Segments | Tommy Bahama | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	14.00%	14.00%	16.00%	18.00%
Wholesale | Operating Segments | Lilly Pulitzer | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	17.00%	14.00%	18.00%	16.00%
Wholesale | Operating Segments | Johnny Was | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	15.00%	19.00%	19.00%	23.00%
Wholesale | Operating Segments | Emerging Brands | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	27.00%	40.00%	38.00%	48.00%
Wholesale | Corporate and Other | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Other
Segment Reporting Information [Line Items]
Net sales	$ (91)	$ 103	$ (158)	$ (30)
Other | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Other | Operating Segments | Tommy Bahama | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Other | Operating Segments | Lilly Pulitzer | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Other | Operating Segments | Johnny Was | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Other | Operating Segments | Emerging Brands | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%