Exhibit 15.4

Consent of Independent Registered Public Accounting Firm

The Board of Directors

We consent to the incorporation by reference on Form 20-F of Fanhua, Inc. of our report dated April 27, 2020, with respect to the consolidated balance sheets of CNFinance Holdings Limited as of December 31, 2019 and 2018, and the related consolidated statements of comprehensive income, changes in shareholders’ equity, and cash flows for each of the years in the three-year period ended December 31, 2019, and the related notes, which report appears in the December 31, 2019 annual report on Form 20-F of CNFinance Holdings Limited.

Our report dated April 27, 2020 contains an explanatory paragraph that states that CNFinance Holdings Limited completed a reorganization through which it became the parent company of Sincere Fame International Limited on March 27, 2018.

/s/ KPMG Huazhen LLP

Guangzhou, China

April 29, 2020