Operating Groups - Assets (Details) - USD ($) $ in Thousands	Feb. 01, 2020	Feb. 02, 2019
Operating groups
Total Assets	$ 1,033,369	$ 727,254
LIFO reserve	63,000	62,000
Corporate and Other
Operating groups
Total Assets	22,059	(16,520)
LIFO reserve	63,000	62,000
Tommy Bahama | Operating Segments
Operating groups
Total Assets	668,197	439,353
Lilly Pulitzer | Operating Segments
Operating groups
Total Assets	199,913	152,113
Lanier Apparel | Operating Segments
Operating groups
Total Assets	43,533	54,369
Southern Tide | Operating Segments
Operating groups
Total Assets	$ 99,667	$ 97,939