Operating Group Information - Net Sales by Distribution Channel (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Nov. 02, 2024	Oct. 28, 2023	Nov. 02, 2024	Oct. 28, 2023
Segment Reporting Information [Line Items]
Net sales	$ 308,025	$ 326,630	$ 1,126,095	$ 1,167,046
Operating Segments | Tommy Bahama
Segment Reporting Information [Line Items]
Net sales	161,289	170,144	631,985	655,022
Operating Segments | Lilly Pulitzer
Segment Reporting Information [Line Items]
Net sales	69,829	76,290	249,939	265,089
Operating Segments | Johnny Was
Segment Reporting Information [Line Items]
Net sales	46,124	49,105	147,616	150,619
Operating Segments | Emerging Brands
Segment Reporting Information [Line Items]
Net sales	30,855	31,155	96,786	96,726
Corporate and Other
Segment Reporting Information [Line Items]
Net sales	(72)	(64)	(231)	(410)
Retail
Segment Reporting Information [Line Items]
Net sales	$ 116,420	$ 121,804	$ 445,113	$ 449,546
Retail | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	38.00%	37.00%	40.00%	38.00%
Retail | Operating Segments | Tommy Bahama | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	45.00%	45.00%	45.00%	45.00%
Retail | Operating Segments | Lilly Pulitzer | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	31.00%	31.00%	35.00%	34.00%
Retail | Operating Segments | Johnny Was | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	37.00%	39.00%	38.00%	38.00%
Retail | Operating Segments | Emerging Brands | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	16.00%	12.00%	17.00%	10.00%
Retail | Corporate and Other | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
E-commerce
Segment Reporting Information [Line Items]
Net sales	$ 101,048	$ 113,531	$ 373,799	$ 391,559
E-commerce | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	33.00%	35.00%	33.00%	34.00%
E-commerce | Operating Segments | Tommy Bahama | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	20.00%	21.00%	24.00%	23.00%
E-commerce | Operating Segments | Lilly Pulitzer | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	55.00%	58.00%	48.00%	51.00%
E-commerce | Operating Segments | Johnny Was | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	41.00%	41.00%	42.00%	40.00%
E-commerce | Operating Segments | Emerging Brands | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	38.00%	41.00%	42.00%	42.00%
E-commerce | Corporate and Other | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Food & Beverage
Segment Reporting Information [Line Items]
Net sales	$ 23,522	$ 22,562	$ 87,291	$ 84,097
Food & Beverage | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	7.00%	7.00%	8.00%	7.00%
Food & Beverage | Operating Segments | Tommy Bahama | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	15.00%	13.00%	14.00%	13.00%
Food & Beverage | Operating Segments | Lilly Pulitzer | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Food & Beverage | Operating Segments | Johnny Was | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Food & Beverage | Operating Segments | Emerging Brands | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Food & Beverage | Corporate and Other | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Wholesale
Segment Reporting Information [Line Items]
Net sales	$ 67,107	$ 68,716	$ 220,122	$ 241,857
Wholesale | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	22.00%	21.00%	19.00%	21.00%
Wholesale | Operating Segments | Tommy Bahama | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	20.00%	21.00%	17.00%	19.00%
Wholesale | Operating Segments | Lilly Pulitzer | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	14.00%	11.00%	17.00%	15.00%
Wholesale | Operating Segments | Johnny Was | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	22.00%	20.00%	20.00%	22.00%
Wholesale | Operating Segments | Emerging Brands | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	46.00%	47.00%	41.00%	48.00%
Wholesale | Corporate and Other | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Other
Segment Reporting Information [Line Items]
Net sales	$ (72)	$ 17	$ (230)	$ (13)
Other | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Other | Operating Segments | Tommy Bahama | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Other | Operating Segments | Lilly Pulitzer | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Other | Operating Segments | Johnny Was | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%
Other | Operating Segments | Emerging Brands | Sales Channel Concentration Risk | Revenue from Contract with Customer Benchmark
Segment Reporting Information [Line Items]
Net sales	0.00%	0.00%	0.00%	0.00%