<?xml version="1.0" encoding="us-ascii"?><InstanceReport xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><Version>2.4.0.8</Version><ReportLongName>22134100 - Disclosure - Retirement, Savings and Deferred Compensation Plans</ReportLongName><DisplayLabelColumn>true</DisplayLabelColumn><ShowElementNames>false</ShowElementNames><RoundingOption /><HasEmbeddedReports>false</HasEmbeddedReports><Columns><Column FlagID="0"><Id>1</Id><IsAbstractGroupTitle>false</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><CurrencyCode /><FootnoteIndexer /><hasSegments>false</hasSegments><hasScenarios>false</hasScenarios><MCU><KeyName /><CurrencySymbol /><contextRef><ContextID>D2012</ContextID><EntitySchema>http://www.sec.gov/CIK</EntitySchema><EntityValue>0001254699</EntityValue><PeriodDisplayName /><PeriodType>duration</PeriodType><PeriodStartDate>2012-01-01T00:00:00</PeriodStartDate><PeriodEndDate>2012-12-31T00:00:00</PeriodEndDate><Segments /><Scenarios /></contextRef><UPS /><CurrencyCode /><OriginalCurrencyCode /></MCU><CurrencySymbol /><Labels><Label Key="CalendarSupplement" Id="0" Label="12 Months Ended" /><Label Key="Calendar" Id="1" Label="Dec. 31, 2012" /></Labels></Column></Columns><Rows><Row FlagID="0"><Id>1</Id><IsAbstractGroupTitle>true</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><Level>1</Level><ElementName>us-gaap_CompensationAndRetirementDisclosureAbstract</ElementName><ElementPrefix>us-gaap_</ElementPrefix><IsBaseElement>true</IsBaseElement><BalanceType>na</BalanceType><PeriodType>duration</PeriodType><IsReportTitle>false</IsReportTitle><IsSegmentTitle>false</IsSegmentTitle><IsCalendarTitle>false</IsCalendarTitle><IsEquityPrevioslyReportedAsRow>false</IsEquityPrevioslyReportedAsRow><IsEquityAdjustmentRow>false</IsEquityAdjustmentRow><IsBeginningBalance>false</IsBeginningBalance><IsEndingBalance>false</IsEndingBalance><IsReverseSign>false</IsReverseSign><FootnoteIndexer /><Cells><Cell FlagID="0" ContextID="" UnitID=""><Id>1</Id><IsNumeric>false</IsNumeric><IsRatio>false</IsRatio><DisplayZeroAsNone>false</DisplayZeroAsNone><NumericAmount>0</NumericAmount><RoundedNumericAmount>0</RoundedNumericAmount><NonNumbericText /><FootnoteIndexer /><CurrencyCode /><CurrencySymbol /><IsIndependantCurrency>false</IsIndependantCurrency><ShowCurrencySymbol>false</ShowCurrencySymbol><DisplayDateInUSFormat>false</DisplayDateInUSFormat></Cell></Cells><ElementDataType>xbrli:stringItemType</ElementDataType><SimpleDataType>string</SimpleDataType><IsTotalLabel>false</IsTotalLabel><UnitID>0</UnitID><Label>Retirement, Savings and Deferred Compensation Plans [Abstract]</Label></Row><Row FlagID="0"><Id>2</Id><IsAbstractGroupTitle>false</IsAbstractGroupTitle><LabelSeparator>

</LabelSeparator><Level>2</Level><ElementName>us-gaap_CompensationAndEmployeeBenefitPlansTextBlock</ElementName><ElementPrefix>us-gaap_</ElementPrefix><IsBaseElement>true</IsBaseElement><BalanceType>na</BalanceType><PeriodType>duration</PeriodType><IsReportTitle>false</IsReportTitle><IsSegmentTitle>false</IsSegmentTitle><IsCalendarTitle>false</IsCalendarTitle><IsEquityPrevioslyReportedAsRow>false</IsEquityPrevioslyReportedAsRow><IsEquityAdjustmentRow>false</IsEquityAdjustmentRow><IsBeginningBalance>false</IsBeginningBalance><IsEndingBalance>false</IsEndingBalance><IsReverseSign>false</IsReverseSign><PreferredLabelRole>terseLabel</PreferredLabelRole><FootnoteIndexer /><Cells><Cell FlagID="0" ContextID="D2012" UnitID=""><Id>1</Id><IsNumeric>false</IsNumeric><IsRatio>false</IsRatio><DisplayZeroAsNone>false</DisplayZeroAsNone><NumericAmount>0</NumericAmount><RoundedNumericAmount>0</RoundedNumericAmount><NonNumbericText>&lt;div style="font-size:10.0pt;font-family:Times New Roman;"&gt;
&lt;div style="FONT-SIZE: 10pt; PADDING-BOTTOM: 12px; TEXT-ALIGN: justify;"&gt;&lt;font style="FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: inherit;"&gt;(12) Retirement, Savings and Deferred Compensation Plans&lt;/font&gt;&lt;/div&gt;
&lt;div style="FONT-SIZE: 10pt; PADDING-BOTTOM: 12px; TEXT-ALIGN: left;"&gt;&lt;font style="FONT-SIZE: 10pt; FONT-FAMILY: inherit;"&gt;QVC-U.S. sponsors a defined contribution plan, the QVC, Inc. 401(k) Matched Savings, Retirement and Success Sharing Plan (the "Plan"). The Plan, which covers substantially all U.S. employees, permits eligible employees to contribute to the Plan on a pre-tax salary reduction basis in accordance with the Internal Revenue Code. Employees may contribute to the Plan immediately upon their start date, with employer contributions beginning after completion of one year of service. Beginning on January 1, 2010, the Company matched a portion of the voluntary employee contributions to the Plan by contributing one dollar for every one dollar contributed by the employee up to 6% of their eligible compensation. Employees become fully vested in employer contributions immediately. The aggregate cost of the Plan, and similar predecessor plans, net of forfeitures, charged to expense was $11 million for each of the&lt;/font&gt; &lt;font style="FONT-SIZE: 10pt; COLOR: #000000; FONT-FAMILY: inherit; TEXT-DECORATION: none;"&gt;years ended December 31, 2012, 2011 and 2010, respectively&lt;/font&gt;&lt;font style="FONT-SIZE: 10pt; FONT-FAMILY: inherit;"&gt;.&lt;/font&gt;&lt;/div&gt;
&lt;div style="FONT-SIZE: 10pt; PADDING-BOTTOM: 12px; TEXT-ALIGN: left;"&gt;&lt;font style="FONT-SIZE: 10pt; FONT-FAMILY: inherit;"&gt;QVC-Germany sponsors a defined contribution Flexible Benefits Plan (the "Benefits Plan") that covers certain employees after six months of service. QVC-Germany's contribution rate to the Benefits Plan amounts to 3% of the eligible annual employee's salary not exceeding the annual social security ceiling plus 9% of the annual salary exceeding the social security ceiling. The cost charged to expense was $1 million for each of the&lt;/font&gt; &lt;font style="FONT-SIZE: 10pt; COLOR: #000000; FONT-FAMILY: inherit; TEXT-DECORATION: none;"&gt;years ended December 31, 2012, 2011 and 2010, respectively&lt;/font&gt;&lt;font style="FONT-SIZE: 10pt; FONT-FAMILY: inherit;"&gt;.&lt;/font&gt;&lt;/div&gt;
&lt;div style="FONT-SIZE: 10pt; PADDING-BOTTOM: 12px; TEXT-ALIGN: left;"&gt;&lt;font style="FONT-SIZE: 10pt; FONT-FAMILY: inherit;"&gt;QVC-U.K. sponsors a defined contribution Employee Pension Plan (the "Pension Plan"), which permits QVC-U.K.'s employees to make contributions at a minimum of 4% of their salary to the Pension Plan on a pre-tax salary reduction basis. Substantially all full-time employees are eligible to participate following the successful completion of a three month probation period. QVC-U.K. contributed an amount equal to 8% of the employee's salary in&lt;/font&gt; &lt;font style="FONT-SIZE: 10pt; COLOR: #000000; FONT-FAMILY: inherit; TEXT-DECORATION: none;"&gt;2012, 2011 and 2010&lt;/font&gt;&lt;font style="FONT-SIZE: 10pt; FONT-FAMILY: inherit;"&gt;. The cost charged to expense was $4 million, $3 million and $2 million for the&lt;/font&gt; &lt;font style="FONT-SIZE: 10pt; COLOR: #000000; FONT-FAMILY: inherit; TEXT-DECORATION: none;"&gt;years ended December 31, 2012, 2011 and 2010, respectively&lt;/font&gt;&lt;font style="FONT-SIZE: 10pt; FONT-FAMILY: inherit;"&gt;.&lt;/font&gt;&lt;/div&gt;
&lt;div style="FONT-SIZE: 10pt; PADDING-BOTTOM: 12px; TEXT-ALIGN: left;"&gt;&lt;font style="FONT-SIZE: 10pt; FONT-FAMILY: inherit;"&gt;The Company offers an unfunded, unsecured deferred compensation plan (the "Deferred Plan") for employees who meet various eligibility requirements, most notably their annual salary exceeds a certain threshold. These eligible employees may elect to defer all or a portion of their salary and earn interest on these amounts. On amounts deferred before December 31, 2005, interest accrues at 12% per annum through a future date originally specified by the employee, and after such time the interest then accrues at the prime lending rate, per the index defined in the Deferred Plan, plus 3%. On amounts deferred after December 31, 2005, interest accrues at the prime lending rate, per the index defined in the Deferred Plan, plus 3%.&lt;/font&gt;&lt;/div&gt;
&lt;/div&gt;</NonNumbericText><FootnoteIndexer /><CurrencyCode /><CurrencySymbol /><IsIndependantCurrency>false</IsIndependantCurrency><ShowCurrencySymbol>false</ShowCurrencySymbol><DisplayDateInUSFormat>false</DisplayDateInUSFormat></Cell></Cells><ElementDataType>nonnum:textBlockItemType</ElementDataType><SimpleDataType>na</SimpleDataType><ElementDefenition>The entire disclosure for an entity's employee compensation and benefit plans, including, but not limited to, postemployment and postretirement benefit plans, defined benefit pension plans, defined contribution plans, non-qualified and supplemental benefit plans, deferred compensation, share-based compensation, life insurance, severance, health care, unemployment and other benefit plans.</ElementDefenition><ElementReferences>No definition available.</ElementReferences><IsTotalLabel>false</IsTotalLabel><UnitID>0</UnitID><Label>Retirement, Savings and Deferred Compensation Plans</Label></Row></Rows><Footnotes /><IsEquityReport>false</IsEquityReport><ReportName>Retirement, Savings and Deferred Compensation Plans</ReportName><MonetaryRoundingLevel>UnKnown</MonetaryRoundingLevel><SharesRoundingLevel>UnKnown</SharesRoundingLevel><PerShareRoundingLevel>UnKnown</PerShareRoundingLevel><ExchangeRateRoundingLevel>UnKnown</ExchangeRateRoundingLevel><HasCustomUnits>true</HasCustomUnits><IsEmbedReport>false</IsEmbedReport><IsMultiCurrency>false</IsMultiCurrency><ReportType>Sheet</ReportType><RoleURI>http://www.qvc.com/role/RetirementSavingsAndDeferredCompensationPlans</RoleURI><NumberOfCols>1</NumberOfCols><NumberOfRows>2</NumberOfRows></InstanceReport>
