<?xml version="1.0" encoding="us-ascii"?><InstanceReport xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><Version>2.4.0.8</Version><ReportLongName>1070 - Disclosure - Impairment Loss</ReportLongName><DisplayLabelColumn>true</DisplayLabelColumn><ShowElementNames>false</ShowElementNames><RoundingOption /><HasEmbeddedReports>false</HasEmbeddedReports><Columns><Column FlagID="0"><Id>1</Id><IsAbstractGroupTitle>false</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><CurrencyCode /><FootnoteIndexer /><hasSegments>false</hasSegments><hasScenarios>false</hasScenarios><MCU><KeyName /><CurrencySymbol /><contextRef><ContextID>D2012</ContextID><EntitySchema>http://www.sec.gov/CIK</EntitySchema><EntityValue>0001065860</EntityValue><PeriodDisplayName /><PeriodType>duration</PeriodType><PeriodStartDate>2012-01-01T00:00:00</PeriodStartDate><PeriodEndDate>2012-12-31T00:00:00</PeriodEndDate><Segments /><Scenarios /></contextRef><UPS /><CurrencyCode /><OriginalCurrencyCode /></MCU><CurrencySymbol /><Labels><Label Key="CalendarSupplement" Id="0" Label="12 Months Ended" /><Label Key="Calendar" Id="1" Label="Dec. 31, 2012" /></Labels></Column></Columns><Rows><Row FlagID="0"><Id>1</Id><IsAbstractGroupTitle>true</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><Level>1</Level><ElementName>lime_AssetImpairmentChargesDisclosureAbstract</ElementName><ElementPrefix>lime_</ElementPrefix><IsBaseElement>false</IsBaseElement><BalanceType>na</BalanceType><PeriodType>duration</PeriodType><IsReportTitle>false</IsReportTitle><IsSegmentTitle>false</IsSegmentTitle><IsCalendarTitle>false</IsCalendarTitle><IsEquityPrevioslyReportedAsRow>false</IsEquityPrevioslyReportedAsRow><IsEquityAdjustmentRow>false</IsEquityAdjustmentRow><IsBeginningBalance>false</IsBeginningBalance><IsEndingBalance>false</IsEndingBalance><IsReverseSign>false</IsReverseSign><FootnoteIndexer /><Cells><Cell FlagID="0" ContextID="" UnitID=""><Id>1</Id><IsNumeric>false</IsNumeric><IsRatio>false</IsRatio><DisplayZeroAsNone>false</DisplayZeroAsNone><NumericAmount>0</NumericAmount><RoundedNumericAmount>0</RoundedNumericAmount><NonNumbericText /><FootnoteIndexer /><CurrencyCode /><CurrencySymbol /><IsIndependantCurrency>false</IsIndependantCurrency><ShowCurrencySymbol>false</ShowCurrencySymbol><DisplayDateInUSFormat>false</DisplayDateInUSFormat></Cell></Cells><ElementDataType>xbrli:stringItemType</ElementDataType><SimpleDataType>string</SimpleDataType><IsTotalLabel>false</IsTotalLabel><UnitID>0</UnitID><Label>Impairment Loss</Label></Row><Row FlagID="0"><Id>2</Id><IsAbstractGroupTitle>false</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><Level>2</Level><ElementName>us-gaap_AssetImpairmentChargesTextBlock</ElementName><ElementPrefix>us-gaap_</ElementPrefix><IsBaseElement>true</IsBaseElement><BalanceType>na</BalanceType><PeriodType>duration</PeriodType><IsReportTitle>false</IsReportTitle><IsSegmentTitle>false</IsSegmentTitle><IsCalendarTitle>false</IsCalendarTitle><IsEquityPrevioslyReportedAsRow>false</IsEquityPrevioslyReportedAsRow><IsEquityAdjustmentRow>false</IsEquityAdjustmentRow><IsBeginningBalance>false</IsBeginningBalance><IsEndingBalance>false</IsEndingBalance><IsReverseSign>false</IsReverseSign><PreferredLabelRole>terseLabel</PreferredLabelRole><FootnoteIndexer /><Cells><Cell FlagID="0" ContextID="D2012" UnitID=""><Id>1</Id><IsNumeric>false</IsNumeric><IsRatio>false</IsRatio><DisplayZeroAsNone>false</DisplayZeroAsNone><NumericAmount>0</NumericAmount><RoundedNumericAmount>0</RoundedNumericAmount><NonNumbericText>&lt;div style="font-size:10.0pt;font-family:Times New Roman;"&gt;
&lt;p style="MARGIN: 0in 0in 0pt;"&gt;&lt;b&gt;&lt;i&gt;&lt;font style="FONT-STYLE: italic; FONT-FAMILY: Times New Roman; FONT-SIZE: 10pt; FONT-WEIGHT: bold;" size="2"&gt;Note 7 &amp;#8212; Impairment Loss&lt;/font&gt;&lt;/i&gt;&lt;/b&gt;&lt;/p&gt;
&lt;p style="MARGIN: 0in 0in 0pt;"&gt;&amp;#160;&lt;/p&gt;
&lt;p style="TEXT-INDENT: 0.25in; MARGIN: 0in 0in 0pt;"&gt;&lt;font style="FONT-FAMILY: Times New Roman; FONT-SIZE: 10pt;" size="2"&gt;During the fourth quarter of 2012, the Company completed a review of the assets of its GES-Port Charlotte subsidiary, which holds the Zemel Road landfill gas to electricity generating facility, and determined that based on its discounted projected future operating cash flows, that the fair market value of the assets was less than the Company&amp;#8217;s current carrying value.&amp;#160; The $2.5 million carrying amount of the intangible asset associated with the facility (Level 3 asset) was written-down to its fair value of $0, resulting in an impairment charge of $2.5 million, which is included in selling, general and administrative expenses. The $4.6 million carrying amount of the generating assets (Level 3 assets) were written-down to their fair value of $3.5 million, resulting in an impairment charge of $1.1 million, which is included in selling, general and administrative expenses during the fourth quarter of 2012.&amp;#160; The total impairment loss for 2012 was $3.5 million.&lt;/font&gt;&lt;/p&gt;
&lt;p style="TEXT-ALIGN: center; MARGIN: 0in 0in 0pt;" align="center"&gt;&amp;#160;&lt;/p&gt;
&lt;p style="TEXT-INDENT: 0.25in; MARGIN: 0in 0in 0pt;"&gt;&lt;font style="FONT-FAMILY: Times New Roman; FONT-SIZE: 10pt;" size="2"&gt;On February&amp;#160;28, 2013, the Company sold its ESCO business, with comprised the majority of its public sector business.&amp;#160; The sales price received for this business was less than the Company&amp;#8217;s carry value, indicating that the assets were impaired.&amp;#160; Accordingly, the Company reduced the carrying value of the property, plant and equipment and intangible assets to $0 and reduced the value of the goodwill associated with the business by $1.4 million.&amp;#160; The total impairment loss record during the fourth quarter of 2012 as a result of these adjustments was $3.2 million.&amp;#160; The impairment loss has been included in the loss from operation of the discontinued business in the accompanying financial statements.&lt;/font&gt;&lt;/p&gt;
&lt;p style="MARGIN: 0in 0in 0pt;"&gt;&amp;#160;&lt;/p&gt;
&lt;p style="TEXT-INDENT: 0.25in; MARGIN: 0in 0in 0pt;"&gt;&lt;font style="FONT-FAMILY: Times New Roman; FONT-SIZE: 10pt;" size="2"&gt;During the fourth quarter of 2011, the Company completed a step 1 impairment analysis and determined that, due to a significant decline in the performance of its C&amp;amp;I reporting unit, the carrying value of its goodwill was impaired.&amp;#160; It then completed a step 2 analysis as required by ASC 350, to calculate the implied fair value of the goodwill.&amp;#160; In a step 2 analysis, the implied fair value of goodwill is determined by measuring the excess of the estimated fair value of the reporting unit, as determined in the first step, over the aggregate estimated fair values of the individual assets, liabilities and identifiable intangibles, as if the reporting unit was being acquired in a business combination.&amp;#160; Utilizing this two-step method the Company determined the implied fair value of the goodwill to be $923 thousand.&amp;#160; To adjust the carrying value of the goodwill from $6.7 million to $923 thousand, it recorded a $5.8 million impairment loss during the period, which is included in discontinued operations in the accompanying financial statements.&lt;/font&gt;&lt;/p&gt;
&lt;p style="MARGIN: 0in 0in 0pt;"&gt;&amp;#160;&lt;/p&gt;
&lt;p style="TEXT-INDENT: 0.25in; MARGIN: 0in 0in 0pt;"&gt;&lt;font style="FONT-FAMILY: Times New Roman; FONT-SIZE: 10pt;" size="2"&gt;Fair value assessment of the reporting unit is considered a Level 3 measurement due to the significant unobservable inputs developed using company specific information. We used a discounted cash flow analysis, which requires unobservable inputs (Level 3) including the selection of an appropriate discount rate and the amount and timing of expected future cash flows, to determine the fair value of the reporting unit. Additionally, fair values reflect a risk premium to the discount rate due to the uncertainty in forecasting future cash flows.&lt;/font&gt;&lt;/p&gt;
&lt;/div&gt;</NonNumbericText><FootnoteIndexer /><CurrencyCode /><CurrencySymbol /><IsIndependantCurrency>false</IsIndependantCurrency><ShowCurrencySymbol>false</ShowCurrencySymbol><DisplayDateInUSFormat>false</DisplayDateInUSFormat></Cell></Cells><ElementDataType>nonnum:textBlockItemType</ElementDataType><SimpleDataType>na</SimpleDataType><ElementDefenition>The entire disclosure for the details of the charge against earnings resulting from the aggregate write down of all assets from their carrying value to their fair value. Disclosure may also include a description of the impaired asset and facts and circumstances leading to the impairment, amount of the impairment loss and where the loss is located in the income statement, method(s) for determining fair value, and the segment in which the impaired asset is reported.</ElementDefenition><ElementReferences>No definition available.</ElementReferences><IsTotalLabel>false</IsTotalLabel><UnitID>0</UnitID><Label>Impairment Loss</Label></Row></Rows><Footnotes /><IsEquityReport>false</IsEquityReport><ReportName>Impairment Loss</ReportName><MonetaryRoundingLevel>UnKnown</MonetaryRoundingLevel><SharesRoundingLevel>UnKnown</SharesRoundingLevel><PerShareRoundingLevel>UnKnown</PerShareRoundingLevel><ExchangeRateRoundingLevel>UnKnown</ExchangeRateRoundingLevel><HasCustomUnits>true</HasCustomUnits><IsEmbedReport>false</IsEmbedReport><IsMultiCurrency>false</IsMultiCurrency><ReportType>Sheet</ReportType><RoleURI>http://www.lime-energy.com/role/DisclosureImpairmentLoss</RoleURI><NumberOfCols>1</NumberOfCols><NumberOfRows>2</NumberOfRows></InstanceReport>
