Intangible Assets and Goodwill (Details 2) - USD ($) $ in Thousands	12 Months Ended
	Feb. 02, 2019	Feb. 03, 2018	Jan. 28, 2017
Changes in the carrying amount of goodwill
Balance at the beginning of the period	$ 66,703	$ 60,015	$ 17,223
Other, including foreign currency	(82)	46	47
Acquisition	0	6,642	42,745
Balance at the end of the period	66,621	66,703	60,015
Operating Segments | Tommy Bahama
Changes in the carrying amount of goodwill
Balance at the beginning of the period	821	775	728
Other, including foreign currency	(67)	46	47
Acquisition	0	0	0
Balance at the end of the period	754	821	775
Operating Segments | Lilly Pulitzer
Changes in the carrying amount of goodwill
Balance at the beginning of the period	19,522	16,495	16,495
Other, including foreign currency	0	0	0
Acquisition	0	3,027	0
Balance at the end of the period	19,522	19,522	16,495
Operating Segments | Southern Tide
Changes in the carrying amount of goodwill
Balance at the beginning of the period	42,745	42,745	0
Other, including foreign currency	0	0	0
Acquisition	0	0	42,745
Balance at the end of the period	42,745	42,745	42,745
Corporate and Other
Changes in the carrying amount of goodwill
Balance at the beginning of the period	3,615	0	0
Other, including foreign currency	(15)	0	0
Acquisition	0	3,615	0
Balance at the end of the period	$ 3,600	$ 3,615	$ 0