Exhibit 23

CONSENT OF INDEPENDENT REGISTERED PUBLIC ACCOUNTING FIRM

We consent to the incorporation by reference in Registration Statement Nos. 333-256679, 333-232164, 333-219252 and 333-222215 on Form S-8 and No. 333-256678 on Form S-3 of Esquire Financial Holdings, Inc. of our report dated March 29, 2024, relating to the consolidated financial statements appearing in this Annual Report on Form 10-K of Esquire Financial Holdings, Inc. for the year ended December 31, 2023.

/s/ Crowe LLP

Livingston, New Jersey

March 29, 2024