Intangible Assets and Goodwill (Details) (USD $)	12 Months Ended
	Jan. 31, 2015	Feb. 01, 2014	Feb. 02, 2013
Intangible assets with finite lives, which primarily consist of customer relationships:
Intangible assets with finite lives, which primarily consist of reacquired license rights and customer relationships:	$ 52,668,000	$ 55,050,000
Accumulated amortization	(44,375,000)	(43,488,000)
Total intangible assets with finite lives, net	8,293,000	11,562,000
Intangible assets with indefinite lives:
Trademarks	159,477,000	161,461,000
Total intangible assets, net	167,770,000	173,023,000	164,317,000
Changes in carrying amount of intangible assets
Balance at the beginning of the period	173,023,000	164,317,000	165,193,000
Acquisition of reacquired license rights		11,041,000
Amortization	(2,481,000)	(2,225,000)	(1,025,000)
Other, including foreign currency changes	(2,772,000)	(110,000)	149,000
Balance at the end of the period	167,770,000	173,023,000	164,317,000
Expected amortization expense
2014	2,100,000
2015	1,900,000
2016	1,800,000
2017	1,600,000
2018	200,000
Tommy Bahama
Intangible assets with indefinite lives:
Total intangible assets, net	117,103,000	119,858,000	111,580,000
Changes in carrying amount of intangible assets
Balance at the beginning of the period	119,858,000	111,580,000	111,964,000
Amortization	(2,004,000)	(1,687,000)	(384,000)
Other, including foreign currency changes	(751,000)	(1,076,000)	0
Balance at the end of the period	117,103,000	119,858,000	111,580,000
Lilly Pulitzer
Intangible assets with indefinite lives:
Total intangible assets, net	29,032,000	29,310,000	29,639,000
Changes in carrying amount of intangible assets
Balance at the beginning of the period	29,310,000	29,639,000	30,028,000
Acquisition of reacquired license rights		0
Amortization	(278,000)	(329,000)	(389,000)
Other, including foreign currency changes	0	0	0
Balance at the end of the period	29,032,000	29,310,000	29,639,000
Ben Sherman
Intangible assets with indefinite lives:
Total intangible assets, net	21,635,000	23,855,000	23,098,000
Changes in carrying amount of intangible assets
Balance at the beginning of the period	23,855,000	23,098,000	23,201,000
Acquisition of reacquired license rights		0
Amortization	(199,000)	(209,000)	(252,000)
Other, including foreign currency changes	(2,021,000)	966,000	149,000
Balance at the end of the period	$ 21,635,000	$ 23,855,000	$ 23,098,000