Segment Reporting (Details) $ in Thousands	3 Months Ended		6 Months Ended
	Jul. 29, 2016 USD ($)	Jul. 31, 2015 USD ($)	Jul. 29, 2016 USD ($)	Jul. 31, 2015 USD ($)	Jan. 29, 2016 USD ($)
Segment Reporting Information
Assets	$ 1,298,438	$ 1,395,688	$ 1,298,438	$ 1,395,688	$ 1,281,526
Earnings Before Interest, Taxes, Depreciation and Amortization	7,260	19,620	7,896	32,670
Depreciation and amortization	4,488	4,061	$ 8,624	8,614
Number of reportable business segments			2
Summary of Segment Data
Net revenue	292,010	312,414	$ 565,443	611,801
Capital expenditures	7,532	2,546	18,017	13,520
Operating segments | Direct
Segment Reporting Information
Assets	980,173	1,078,682	980,173	1,078,682	953,502
Earnings Before Interest, Taxes, Depreciation and Amortization	14,780	26,687	27,612	48,365
Depreciation and amortization	3,720	3,200	7,070	6,895
Summary of Segment Data
Net revenue	246,395	264,735	478,580	518,108
Capital expenditures	7,461	2,419	17,763	13,302
Operating segments | Retail
Segment Reporting Information
Assets	78,011	76,593	78,011	76,593	69,321
Earnings Before Interest, Taxes, Depreciation and Amortization	450	663	(3,480)	807
Depreciation and amortization	406	499	825	996
Summary of Segment Data
Net revenue	45,521	47,577	86,737	93,569
Capital expenditures	71	53	254	53
Operating segments | Corporate and Reconciling Items [Member]
Segment Reporting Information
Assets	240,254	240,413	240,254	240,413	$ 258,703
Earnings Before Interest, Taxes, Depreciation and Amortization	(7,970)	(7,730)	(16,236)	(16,502)
Depreciation and amortization	362	362	729	723
Summary of Segment Data
Net revenue	94	102	126	124
Capital expenditures	0	74	0	165
Apparel [Member]
Summary of Segment Data
Net revenue	241,822	258,168	472,980	511,613
Non-apparel [Member]
Summary of Segment Data
Net revenue	30,517	34,503	57,167	65,828
Services and Other [Member]
Summary of Segment Data
Net revenue	$ 19,671	$ 19,743	$ 35,296	$ 34,360