Operating Group Information - Depreciation and Amortization (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Nov. 02, 2024	Oct. 28, 2023	Nov. 02, 2024	Oct. 28, 2023
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	$ 17,205	$ 16,020	$ 50,296	$ 46,479
Operating Segments | Tommy Bahama
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	7,188	6,299	21,385	18,356
Operating Segments | Lilly Pulitzer
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	4,757	4,372	14,075	11,743
Operating Segments | Johnny Was
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	4,340	4,684	12,383	14,593
Operating Segments | Emerging Brands
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	801	504	2,078	1,389
Corporate and Other
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	$ 119	$ 161	$ 375	$ 398