<?xml version="1.0" encoding="us-ascii"?><InstanceReport xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><Version>2.4.0.8</Version><ReportLongName>110 - Disclosure - Future Abandonment Cost</ReportLongName><DisplayLabelColumn>true</DisplayLabelColumn><ShowElementNames>false</ShowElementNames><RoundingOption /><HasEmbeddedReports>false</HasEmbeddedReports><Columns><Column FlagID="0"><Id>1</Id><IsAbstractGroupTitle>false</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><CurrencyCode /><FootnoteIndexer /><hasSegments>false</hasSegments><hasScenarios>false</hasScenarios><MCU><KeyName /><CurrencySymbol /><contextRef><ContextID>eol_PE742405--138-K-0014_STD_181_20130630_0</ContextID><EntitySchema>http://www.sec.gov/CIK</EntitySchema><EntityValue>0001397516</EntityValue><PeriodDisplayName /><PeriodType>duration</PeriodType><PeriodStartDate>2013-01-01T00:00:00</PeriodStartDate><PeriodEndDate>2013-06-30T00:00:00</PeriodEndDate><Segments /><Scenarios /></contextRef><UPS /><CurrencyCode /><OriginalCurrencyCode /></MCU><CurrencySymbol /><Labels><Label Key="CalendarSupplement" Id="0" Label="6 Months Ended" /><Label Key="Calendar" Id="1" Label="Jun. 30, 2013" /></Labels></Column></Columns><Rows><Row FlagID="0"><Id>1</Id><IsAbstractGroupTitle>false</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><Level>4</Level><ElementName>us-gaap_AssetRetirementObligationDisclosureTextBlock</ElementName><ElementPrefix>us-gaap_</ElementPrefix><IsBaseElement>true</IsBaseElement><BalanceType>na</BalanceType><PeriodType>duration</PeriodType><IsReportTitle>false</IsReportTitle><IsSegmentTitle>false</IsSegmentTitle><IsCalendarTitle>false</IsCalendarTitle><IsEquityPrevioslyReportedAsRow>false</IsEquityPrevioslyReportedAsRow><IsEquityAdjustmentRow>false</IsEquityAdjustmentRow><IsBeginningBalance>false</IsBeginningBalance><IsEndingBalance>false</IsEndingBalance><IsReverseSign>false</IsReverseSign><PreferredLabelRole>terseLabel</PreferredLabelRole><FootnoteIndexer /><Cells><Cell FlagID="0" ContextID="eol_PE742405--138-K-0014_STD_181_20130630_0" UnitID=""><Id>1</Id><IsNumeric>false</IsNumeric><IsRatio>false</IsRatio><DisplayZeroAsNone>false</DisplayZeroAsNone><NumericAmount>0</NumericAmount><RoundedNumericAmount>0</RoundedNumericAmount><NonNumbericText>&lt;div&gt;
 &lt;p style="MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;&lt;b&gt;3. FUTURE ABANDONMENT
 COST&lt;/b&gt;&lt;/font&gt;&lt;/p&gt;
 &lt;p style="MARGIN-TOP: 6px; TEXT-INDENT: 4%; MARGIN-BOTTOM: 0px"&gt;
 &lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;Future
 abandonment costs are recognized as obligations associated with the
 retirement of tangible long-lived assets that result from the
 acquisition and development of the asset. We recognize the fair
 value of a liability for a retirement obligation in the period in
 which the liability is incurred. For natural gas and oil
 properties, this is the period in which the natural gas or oil well
 is acquired or drilled. The future abandonment cost is capitalized
 as part of the carrying amount of our natural gas and oil
 properties at its discounted fair value. The liability is then
 accreted each period until the liability is settled or the natural
 gas or oil well is sold, at which time the liability is reversed.
 If the fair value of a recorded future abandonment cost changes, a
 revision is recorded to both the asset retirement obligation and
 the asset retirement cost.&lt;/font&gt;&lt;/p&gt;
 &lt;p style="MARGIN-TOP: 12px; TEXT-INDENT: 4%; MARGIN-BOTTOM: 0px"&gt;
 &lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;Accretion
 expense totaled approximately $0.5 million and $1.1 million for the
 three and six-month periods ended June&amp;#xA0;30, 2013, respectively,
 as compared to $0.5 million and $0.9 million for the three and six
 months ended June&amp;#xA0;30, 2012, respectively. These amounts are
 recorded as depreciation, depletion, amortization and accretion
 (&amp;#x201C;DD&amp;amp;A&amp;#x201D;) expense on our Consolidated Statements of
 Operations. We account for future abandonment costs that relate to
 wells that are drilled jointly based on our working interest in
 those wells.&lt;/font&gt;&lt;/p&gt;
 &lt;p style="MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px; FONT-SIZE: 12px"&gt;
 &amp;#xA0;&lt;/p&gt;
 &lt;table style="BORDER-COLLAPSE: collapse" border="0" cellspacing="0" cellpadding="0" width="68%" align="center"&gt;
 &lt;tr&gt;
 &lt;td width="84%"&gt;&lt;/td&gt;
 &lt;td valign="bottom" width="10%"&gt;&lt;/td&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;td&gt;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td valign="bottom"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="1"&gt;&lt;i&gt;$ in Thousands&lt;/i&gt;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font size="1"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td style="BORDER-BOTTOM: #000000 1px solid" valign="bottom" colspan="2" align="center"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="1"&gt;&lt;b&gt;June&amp;#xA0;30,&amp;#xA0;2013&lt;/b&gt;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font size="1"&gt;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr bgcolor="#CCEEFF"&gt;
 &lt;td valign="top"&gt;
 &lt;p style="TEXT-INDENT: -1em; MARGIN-LEFT: 1em"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;Beginning Balance at
 December&amp;#xA0;31, 2012&lt;/font&gt;&lt;/p&gt;
 &lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font size="1"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;$&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" align="right"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;24,822&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" nowrap="nowrap"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td valign="top"&gt;
 &lt;p style="TEXT-INDENT: -1em; MARGIN-LEFT: 1em"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;Future Abandonment
 Obligation Incurred&lt;/font&gt;&lt;/p&gt;
 &lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font size="1"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" align="right"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;570&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" nowrap="nowrap"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr bgcolor="#CCEEFF"&gt;
 &lt;td valign="top"&gt;
 &lt;p style="TEXT-INDENT: -1em; MARGIN-LEFT: 1em"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;Future Abandonment
 Obligation Settled&lt;/font&gt;&lt;/p&gt;
 &lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font size="1"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" align="right"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;(470&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" nowrap="nowrap"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;)&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td valign="top"&gt;
 &lt;p style="TEXT-INDENT: -1em; MARGIN-LEFT: 1em"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;Future Abandonment
 Obligation Revision of Estimated Obligation&lt;/font&gt;&lt;/p&gt;
 &lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font size="1"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" align="right"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;160&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" nowrap="nowrap"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr bgcolor="#CCEEFF"&gt;
 &lt;td valign="top"&gt;
 &lt;p style="TEXT-INDENT: -1em; MARGIN-LEFT: 1em"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;Future Abandonment
 Obligation Accretion Expense&lt;/font&gt;&lt;/p&gt;
 &lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font size="1"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" align="right"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;1,090&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" nowrap="nowrap"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr style="FONT-SIZE: 1px"&gt;
 &lt;td valign="bottom"&gt;&lt;/td&gt;
 &lt;td valign="bottom"&gt;&amp;#xA0;&amp;#xA0;&lt;/td&gt;
 &lt;td valign="bottom"&gt;
 &lt;p style="BORDER-TOP: #000000 1px solid"&gt;&amp;#xA0;&lt;/p&gt;
 &lt;/td&gt;
 &lt;td valign="bottom"&gt;
 &lt;p style="BORDER-TOP: #000000 1px solid"&gt;&amp;#xA0;&lt;/p&gt;
 &lt;/td&gt;
 &lt;td&gt;&amp;#xA0;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr&gt;
 &lt;td valign="top"&gt;
 &lt;p style="TEXT-INDENT: -1em; MARGIN-LEFT: 3em"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;Total Future Abandonment
 Cost&lt;/font&gt;&lt;/p&gt;
 &lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font size="1"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;$&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" align="right"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;26,172&lt;/font&gt;&lt;/td&gt;
 &lt;td valign="bottom" nowrap="nowrap"&gt;&lt;font style="FONT-FAMILY: Times New Roman" size="2"&gt;&amp;#xA0;&amp;#xA0;&lt;/font&gt;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;tr style="FONT-SIZE: 1px"&gt;
 &lt;td valign="bottom"&gt;&lt;/td&gt;
 &lt;td valign="bottom"&gt;&amp;#xA0;&amp;#xA0;&lt;/td&gt;
 &lt;td valign="bottom"&gt;
 &lt;p style="BORDER-TOP: #000000 3px double"&gt;&amp;#xA0;&lt;/p&gt;
 &lt;/td&gt;
 &lt;td valign="bottom"&gt;
 &lt;p style="BORDER-TOP: #000000 3px double"&gt;&amp;#xA0;&lt;/p&gt;
 &lt;/td&gt;
 &lt;td&gt;&amp;#xA0;&lt;/td&gt;
 &lt;/tr&gt;
 &lt;/table&gt;
 &lt;/div&gt;</NonNumbericText><FootnoteIndexer /><CurrencyCode /><CurrencySymbol /><IsIndependantCurrency>false</IsIndependantCurrency><ShowCurrencySymbol>false</ShowCurrencySymbol><DisplayDateInUSFormat>false</DisplayDateInUSFormat></Cell></Cells><ElementDataType>nonnum:textBlockItemType</ElementDataType><SimpleDataType>na</SimpleDataType><ElementDefenition>The entire disclosure for an asset retirement obligation and the associated long-lived asset. An asset retirement obligation is a legal obligation associated with the disposal or retirement from service of a tangible long-lived asset that results from the acquisition, construction or development, or the normal operations of a long-lived asset, except for certain obligations of lessees.</ElementDefenition><ElementReferences>Reference 1: http://www.xbrl.org/2003/role/presentationRef

 -Publisher FASB

 -Name Accounting Standards Codification

 -Topic 410

 -SubTopic 20

 -Section 50

 -Paragraph 1

 -URI http://asc.fasb.org/extlink&amp;oid=6392692&amp;loc=d3e7535-110849



Reference 2: http://www.xbrl.org/2003/role/presentationRef

 -Publisher FASB

 -Name Accounting Standards Codification

 -Topic 410

 -SubTopic 20

 -Section 50

 -Paragraph 2

 -URI http://asc.fasb.org/extlink&amp;oid=6392692&amp;loc=d3e7569-110849



</ElementReferences><IsTotalLabel>false</IsTotalLabel><UnitID>0</UnitID><Label>Future Abandonment Cost</Label></Row></Rows><Footnotes /><IsEquityReport>false</IsEquityReport><ReportName>Future Abandonment Cost</ReportName><MonetaryRoundingLevel>UnKnown</MonetaryRoundingLevel><SharesRoundingLevel>UnKnown</SharesRoundingLevel><PerShareRoundingLevel>UnKnown</PerShareRoundingLevel><ExchangeRateRoundingLevel>UnKnown</ExchangeRateRoundingLevel><HasCustomUnits>true</HasCustomUnits><IsEmbedReport>false</IsEmbedReport><IsMultiCurrency>false</IsMultiCurrency><ReportType>Sheet</ReportType><RoleURI>http://www.rexenergycorp.com/taxonomy/role/NotesToFinancialStatementsAssetRetirementObligationDisclosureTextBlock</RoleURI><NumberOfCols>1</NumberOfCols><NumberOfRows>1</NumberOfRows></InstanceReport>
