Intangible Assets and Goodwill (Details 2) - USD ($) $ in Thousands	12 Months Ended
	Feb. 03, 2018	Jan. 28, 2017	Jan. 30, 2016
Changes in the carrying amount of goodwill
Balance at the beginning of the period	$ 60,015	$ 17,223	$ 17,296
Other, including foreign currency	46	47	(73)
Acquisition	6,642	42,745
Balance at the end of the period	66,703	60,015	17,223
Operating Segments | Tommy Bahama
Changes in the carrying amount of goodwill
Balance at the beginning of the period	775	728	801
Other, including foreign currency	46	47	(73)
Acquisition	0	0
Balance at the end of the period	821	775	728
Operating Segments | Lilly Pulitzer
Changes in the carrying amount of goodwill
Balance at the beginning of the period	16,495	16,495	16,495
Other, including foreign currency	0	0	0
Acquisition	3,027	0
Balance at the end of the period	19,522	16,495	16,495
Operating Segments | Southern Tide
Changes in the carrying amount of goodwill
Balance at the beginning of the period	42,745
Other, including foreign currency	0	0	0
Acquisition	0	42,745
Balance at the end of the period	42,745	42,745
Corporate and Other
Changes in the carrying amount of goodwill
Other, including foreign currency	0	0	$ 0
Acquisition	3,615	$ 0
Balance at the end of the period	$ 3,615