Operating Group Information - Depreciation and Amortization (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Aug. 03, 2024	Jul. 29, 2023	Aug. 03, 2024	Jul. 29, 2023
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	$ 16,550	$ 15,287	$ 33,091	$ 30,459
Operating Segments | Tommy Bahama
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	7,004	6,073	14,197	12,057
Operating Segments | Lilly Pulitzer
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	4,724	3,979	9,318	7,371
Operating Segments | Johnny Was
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	4,037	4,717	8,043	9,909
Operating Segments | Emerging Brands
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	663	460	1,277	885
Corporate and Other
Segment, Reconciliation of Other Items from Segments to Consolidated [Line Items]
Depreciation and amortization	$ 122	$ 58	$ 256	$ 237