Exhibit 23

CONSENT OF INDEPENDENT REGISTERED PUBLIC ACCOUNTING FIRM

We hereby consent to the incorporation by reference in the Registration Statements on Form S-8 (No. 333-177724, 333-168446, and 333-125306) of Carter's, Inc. of our report dated February 29, 2012 relating to the financial statements and the effectiveness of internal control over financial reporting, which appears in this Form 10-K.

/s/ PricewaterhouseCoopers, LLP

Stamford, Connecticut

February 29, 2012