<?xml version="1.0" encoding="us-ascii"?><InstanceReport xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><Version>2.4.0.8</Version><ReportLongName>060700 - Disclosure - Long-Term Debt</ReportLongName><DisplayLabelColumn>true</DisplayLabelColumn><ShowElementNames>false</ShowElementNames><RoundingOption /><HasEmbeddedReports>false</HasEmbeddedReports><Columns><Column FlagID="0"><Id>1</Id><IsAbstractGroupTitle>false</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><CurrencyCode /><FootnoteIndexer /><hasSegments>false</hasSegments><hasScenarios>false</hasScenarios><MCU><KeyName /><CurrencySymbol /><contextRef><ContextID>c20130204to20130804</ContextID><EntitySchema>http://www.sec.gov/CIK</EntitySchema><EntityValue>0000030302</EntityValue><PeriodDisplayName /><PeriodType>duration</PeriodType><PeriodStartDate>2013-02-04T00:00:00</PeriodStartDate><PeriodEndDate>2013-08-04T00:00:00</PeriodEndDate><Segments /><Scenarios /></contextRef><UPS /><CurrencyCode /><OriginalCurrencyCode /></MCU><CurrencySymbol /><Labels><Label Key="CalendarSupplement" Id="0" Label="6 Months Ended" /><Label Key="Calendar" Id="1" Label="Aug. 04, 2013" /></Labels></Column></Columns><Rows><Row FlagID="0"><Id>1</Id><IsAbstractGroupTitle>true</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><Level>1</Level><ElementName>us-gaap_DebtDisclosureAbstract</ElementName><ElementPrefix>us-gaap_</ElementPrefix><IsBaseElement>true</IsBaseElement><BalanceType>na</BalanceType><PeriodType>duration</PeriodType><IsReportTitle>false</IsReportTitle><IsSegmentTitle>false</IsSegmentTitle><IsCalendarTitle>false</IsCalendarTitle><IsEquityPrevioslyReportedAsRow>false</IsEquityPrevioslyReportedAsRow><IsEquityAdjustmentRow>false</IsEquityAdjustmentRow><IsBeginningBalance>false</IsBeginningBalance><IsEndingBalance>false</IsEndingBalance><IsReverseSign>false</IsReverseSign><FootnoteIndexer /><Cells><Cell FlagID="0" ContextID="" UnitID=""><Id>1</Id><IsNumeric>false</IsNumeric><IsRatio>false</IsRatio><DisplayZeroAsNone>false</DisplayZeroAsNone><NumericAmount>0</NumericAmount><RoundedNumericAmount>0</RoundedNumericAmount><NonNumbericText /><FootnoteIndexer /><CurrencyCode /><CurrencySymbol /><IsIndependantCurrency>false</IsIndependantCurrency><ShowCurrencySymbol>false</ShowCurrencySymbol><DisplayDateInUSFormat>false</DisplayDateInUSFormat></Cell></Cells><ElementDataType>xbrli:stringItemType</ElementDataType><SimpleDataType>string</SimpleDataType><IsTotalLabel>false</IsTotalLabel><UnitID>0</UnitID><Label>Long-Term Debt [Abstract]</Label></Row><Row FlagID="0"><Id>2</Id><IsAbstractGroupTitle>false</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><Level>2</Level><ElementName>us-gaap_DebtDisclosureTextBlock</ElementName><ElementPrefix>us-gaap_</ElementPrefix><IsBaseElement>true</IsBaseElement><BalanceType>na</BalanceType><PeriodType>duration</PeriodType><IsReportTitle>false</IsReportTitle><IsSegmentTitle>false</IsSegmentTitle><IsCalendarTitle>false</IsCalendarTitle><IsEquityPrevioslyReportedAsRow>false</IsEquityPrevioslyReportedAsRow><IsEquityAdjustmentRow>false</IsEquityAdjustmentRow><IsBeginningBalance>false</IsBeginningBalance><IsEndingBalance>false</IsEndingBalance><IsReverseSign>false</IsReverseSign><PreferredLabelRole>label</PreferredLabelRole><FootnoteIndexer /><Cells><Cell FlagID="0" ContextID="c20130204to20130804" UnitID=""><Id>1</Id><IsNumeric>false</IsNumeric><IsRatio>false</IsRatio><DisplayZeroAsNone>false</DisplayZeroAsNone><NumericAmount>0</NumericAmount><RoundedNumericAmount>0</RoundedNumericAmount><NonNumbericText>&lt;div&gt;&lt;div&gt;&lt;table align="center" border="0" cellpadding="0" cellspacing="0" style="width: 100%; font-family: Times New Roman; font-size: 10pt;"&gt;&lt;tr valign="top"&gt;&lt;td style="width: 18pt;"&gt;&lt;div style="text-indent: 0pt; font-family: Times New Roman; margin-left: 0pt; font-size: 10pt; margin-right: 0pt;"&gt;(7)&lt;/div&gt;&lt;/td&gt;&lt;td&gt;&lt;div style="text-align: left; font-family: Times New Roman; font-size: 10pt; text-decoration: underline;"&gt;Long-Term Debt&lt;/div&gt;&lt;/td&gt;&lt;/tr&gt;&lt;/table&gt;&lt;/div&gt;&lt;div style="text-align: justify; text-indent: 0pt; display: block; margin-left: 0pt; margin-right: 0pt;"&gt;&amp;#160;&lt;/div&gt;&lt;div style="text-align: justify; text-indent: 36pt; display: block; font-family: Times New Roman; margin-left: 0pt; font-size: 10pt; margin-right: 0pt;"&gt;On July 21, 2011, the Company entered into a five-year revolving Credit Agreement (the "Facility") with Wells Fargo Bank, National Association and Wells Capital Finance, LLC (collectively "Wells Fargo").&amp;#160;&amp;#160;The $120.0 million Facility replaced the Company's previous $120.0 million credit facility with Bank of America, N.A. and Wells Fargo Retail Finance, LLC, and expires July 20, 2016.&amp;#160;&amp;#160;Additional costs paid to Wells Fargo in connection with the new facility were $0.5 million.&amp;#160;&amp;#160;Those fees have been deferred and will be amortized over the term of the new facility.&amp;#160;&amp;#160;Loan advances are secured by a security interest in the Company's inventory and credit card receivables.&amp;#160;&lt;/div&gt;&lt;div style="text-align: justify; text-indent: 0pt; display: block; margin-left: 0pt; margin-right: 0pt;"&gt;&amp;#160;&lt;/div&gt;&lt;div style="text-align: justify; text-indent: 36pt; display: block; font-family: Times New Roman; margin-left: 0pt; font-size: 10pt; margin-right: 0pt;"&gt;Based on the Company's average excess availability, the amount advanced to the Company on any Base Rate Loan (as such term is defined in the Facility) bears interest at the highest of (a) the rate of interest in effect for such day as publicly announced from time to time by Wells Fargo as its "prime rate"; (b) the Federal Funds Rate for such day, plus 1.0%; and (c) the LIBO Rate for a 30 day interest period as determined on such day, plus 2.0%.&amp;#160;&amp;#160;Amounts advanced with respect to any LIBO Borrowing for any Interest Period (as those terms are defined in the Facility) shall bear interest at an interest rate per annum (rounded upwards, if necessary, to the next 1/16 of one percent) equal to (a) the LIBO Rate for such Interest Period multiplied by (b) the Statutory Reserve Rate (as defined in the Facility).&amp;#160;&amp;#160;The Facility contains various restrictions that are applicable when outstanding borrowings reach certain thresholds, including limitations on additional indebtedness, prepayments, acquisition of assets, granting of liens, certain investments and payment of dividends.&lt;/div&gt;&lt;div style="text-align: justify; text-indent: 0pt; display: block; margin-left: 0pt; margin-right: 0pt;"&gt;&amp;#160;&lt;/div&gt;&lt;div style="text-align: left; text-indent: 36pt; display: block; font-family: Times New Roman; margin-left: 0pt; font-size: 10pt; margin-right: 0pt;"&gt;On October 12, 2012, subsequent to a trade confirmation executed October 10, 2012 whereby the Company repurchased shares of its Common Stock, the Company notified Wells Fargo that immediately after giving effect to the share repurchase, the Consolidated Fixed Charge Coverage Ratio would not be greater than the required ratio per Section 7.06(c) of the Facility.&amp;#160;&amp;#160;On October 12, 2012, Wells Fargo issued its consent of the repurchase (the "WF Consent"); provided that the WF Consent automatically terminated in the event the repurchase was not consummated within 90 days of the date of consent.&lt;/div&gt;&lt;div style="text-align: justify; text-indent: 0pt; display: block; margin-left: 0pt; margin-right: 0pt;"&gt;&amp;#160;&lt;/div&gt;&lt;div style="text-align: left; text-indent: 36pt; display: block; font-family: Times New Roman; margin-left: 0pt; font-size: 10pt; margin-right: 0pt;"&gt;On February 6, 2013, the Board of Directors of the Company unanimously approved a First Amendment (the "Amendment") to its Credit Agreement with Wells Fargo National Association, amending Section 7.06(c) of the Credit Agreement to permit the Company, subject to certain conditions set forth in the Amendment, to repurchase, redeem or otherwise acquire Equity Interests issued by the Company not to exceed $1.0 million in the aggregate in each fiscal year.&amp;#160;&amp;#160;Under the Credit Agreement, "Equity Interests" is defined as all of the shares of the capital stock of a person and all of the other warrants, options or other rights of a person to purchase capital stock of such person.&amp;#160;&amp;#160;Such amendment was announced on Form 8-K filed by the Company with the Securities and Exchange Commission on February 12, 2013 and a copy of the Amendment is attached to such 8-K.&amp;#160;&amp;#160;Except to the extent specifically set forth in the WF Consent and the Amendment, no other consent, waiver of, or change in any of the terms, provisions or conditions of the Credit Agreement is intended or implied.&lt;/div&gt;&lt;div style="text-align: justify; text-indent: 0pt; display: block; margin-left: 0pt; margin-right: 0pt;"&gt;&amp;#160;&lt;/div&gt;&lt;div style="text-align: left; text-indent: 36pt; display: block; font-family: Times New Roman; margin-left: 0pt; font-size: 10pt; margin-right: 0pt;"&gt;Notes payable outstanding at August 4, 2013 and July 29, 2012 under the revolving loan credit facility aggregated $81.6 million and $41.5 million, respectively.&amp;#160; The lender had also issued letters of credit aggregating $10.0 million and $8.7 million, respectively, at such dates on behalf of the Company.&amp;#160; The interest rates on the outstanding borrowings at August 4, 2013 were 2.25% on $70.0 million of the outstanding balance and 4.25% on the remaining $11.6 million.&amp;#160; The Company had additional borrowings available at August 4, 2013 under the revolving loan credit facility amounting to approximately $28.5 million.&amp;#160;&lt;/div&gt;&lt;div style="text-align: justify; text-indent: 0pt; display: block; margin-left: 0pt; margin-right: 0pt;"&gt;&amp;#160;&lt;/div&gt;&lt;div style="text-align: left; text-indent: 36pt; display: block; font-family: Times New Roman; margin-left: 0pt; font-size: 10pt; margin-right: 0pt;"&gt;Interest expense on notes payable and long-term debt, excluding capital lease obligations and amortization of debt financing costs, aggregated $0.6 million and $0.5 million during the second quarter of fiscal 2014 and fiscal 2013, respectively.&amp;#160;&amp;#160;Interest expense on notes payable and long-term debt, excluding capital lease obligations and amortization of debt financing costs, aggregated $1.2 million and $0.9 million during the twenty-six weeks ended August 4, 2013 and July 29, 2012, respectively&amp;#160;&lt;/div&gt;&lt;div style="text-align: justify; text-indent: 0pt; display: block; margin-left: 0pt; margin-right: 0pt;"&gt;&amp;#160;&lt;/div&gt;&lt;/div&gt;</NonNumbericText><FootnoteIndexer /><CurrencyCode /><CurrencySymbol /><IsIndependantCurrency>false</IsIndependantCurrency><ShowCurrencySymbol>false</ShowCurrencySymbol><DisplayDateInUSFormat>false</DisplayDateInUSFormat></Cell></Cells><ElementDataType>nonnum:textBlockItemType</ElementDataType><SimpleDataType>na</SimpleDataType><ElementDefenition>The entire disclosure for information about short-term and long-term debt arrangements, which includes amounts of borrowings under each line of credit, note payable, commercial paper issue, bonds indenture, debenture issue, own-share lending arrangements and any other contractual agreement to repay funds, and about the underlying arrangements, rationale for a classification as long-term, including repayment terms, interest rates, collateral provided, restrictions on use of assets and activities, whether or not in compliance with debt covenants, and other matters important to users of the financial statements, such as the effects of refinancing and noncompliance with debt covenants.</ElementDefenition><ElementReferences>Reference 1: http://www.xbrl.org/2003/role/presentationRef

 -Publisher FASB

 -Name Accounting Standards Codification

 -Topic 505

 -SubTopic 10

 -Section 50

 -Paragraph 3

 -URI http://asc.fasb.org/extlink&amp;oid=6928386&amp;loc=d3e21475-112644



Reference 2: http://www.xbrl.org/2003/role/presentationRef

 -Publisher SEC

 -Name Regulation S-X (SX)

 -Number 210

 -Section 02

 -Paragraph 19, 20, 22

 -Article 5



Reference 3: http://www.xbrl.org/2003/role/presentationRef

 -Publisher FASB

 -Name Statement of Financial Accounting Standard (FAS)

 -Number 129

 -Paragraph 2, 4

 -LegacyDoc This reference is SUPERSEDED by the Accounting Standards Codification effective for interim and annual periods ending after September 15, 2009.  This reference is included to help users transition from the previous accounting hierarchy and will be removed from future versions of this taxonomy.



Reference 4: http://www.xbrl.org/2003/role/presentationRef

 -Publisher FASB

 -Name Accounting Standards Codification

 -Topic 210

 -SubTopic 10

 -Section S99

 -Paragraph 1

 -Subparagraph (SX 210.5-02.19,20,22)

 -URI http://asc.fasb.org/extlink&amp;oid=6877327&amp;loc=d3e13212-122682



</ElementReferences><IsTotalLabel>false</IsTotalLabel><UnitID>0</UnitID><Label>Debt Disclosure [Text Block]</Label></Row></Rows><Footnotes /><IsEquityReport>false</IsEquityReport><ReportName>Long-Term Debt</ReportName><MonetaryRoundingLevel>UnKnown</MonetaryRoundingLevel><SharesRoundingLevel>UnKnown</SharesRoundingLevel><PerShareRoundingLevel>UnKnown</PerShareRoundingLevel><ExchangeRateRoundingLevel>UnKnown</ExchangeRateRoundingLevel><HasCustomUnits>true</HasCustomUnits><IsEmbedReport>false</IsEmbedReport><IsMultiCurrency>false</IsMultiCurrency><ReportType>Sheet</ReportType><RoleURI>http://alcostores.com/role/LongtermDebt</RoleURI><NumberOfCols>1</NumberOfCols><NumberOfRows>2</NumberOfRows></InstanceReport>
