Exhibit 23

Consent of Independent Registered Public Accounting Firm

We consent to the incorporation by reference in the Registration Statements (Form S-3 No. 333-179805 and Form S-8 No. 333-166609 and No. 333-150535) of Hatteras Financial Corp. and in the related Prospectuses of our reports dated February 20, 2013, with respect to the financial statements of Hatteras Financial Corp., and the effectiveness of internal control over financial reporting of Hatteras Financial Corp., included in this Annual Report (Form 10-K) for the year ended December 31, 2012.

/s/ Ernst & Young LLP

Raleigh, North Carolina

February 20, 2013