Operating Groups Information - Assets (Details) - USD ($) $ in Thousands	3 Months Ended
	May 02, 2020	May 01, 2021	Jan. 30, 2021
Operating groups
Assets	$ 1,097,470	$ 900,982	$ 865,634
Impairment of goodwill and intangible assets	60,452
Corporate and Other
Operating groups
Assets	167,634	100,800	76,705
Tommy Bahama | Operating Segments
Operating groups
Assets	650,057	569,391	569,854
Lilly Pulitzer | Operating Segments
Operating groups
Assets	202,983	188,886	176,467
Southern Tide | Operating Segments
Operating groups
Assets	37,513	32,285	31,641
Lanier Apparel | Operating Segments
Operating groups
Assets	$ 39,283	$ 9,620	$ 10,967