Operating Group Information - Financial information (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Aug. 03, 2019	Aug. 04, 2018	Aug. 03, 2019	Aug. 04, 2018
Operating groups
Net sales	$ 302,000	$ 302,641	$ 583,973	$ 575,269
Depreciation and amortization	9,849	11,471	19,986	21,597
Operating income	40,259	36,513	70,001	64,886
Interest expense, net	419	602	1,090	1,383
Earnings before income taxes	39,840	35,911	68,911	63,503
Corporate and Other
Operating groups
Net sales	4,202	2,653	8,127	6,141
Depreciation and amortization	285	312	625	627
Operating income	(5,495)	(4,774)	(9,896)	(9,379)
Tommy Bahama | Operating Segments
Operating groups
Net sales	188,870	192,728	353,600	359,860
Depreciation and amortization	6,907	8,260	13,747	15,326
Operating income	23,218	20,621	38,410	34,924
Lilly Pulitzer | Operating Segments
Operating groups
Net sales	75,555	71,623	148,150	140,250
Depreciation and amortization	2,381	2,624	5,064	5,103
Operating income	20,449	18,421	35,701	34,247
Lanier Apparel | Operating Segments
Operating groups
Net sales	20,905	23,860	47,494	43,769
Depreciation and amortization	141	139	281	280
Operating income	253	825	1,435	1,187
Southern Tide | Operating Segments
Operating groups
Net sales	12,468	11,777	26,602	25,249
Depreciation and amortization	135	136	269	261
Operating income	$ 1,834	$ 1,420	$ 4,351	$ 3,907