Exhibit 23

CONSENT OF INDEPENDENT REGISTERED PUBLIC ACCOUNTING FIRM

We have issued our report dated March 19, 2014, accompanying the audited consolidated financial statements incorporated by reference in the Annual Report of United Bancorp, Inc. on Form 10-K for the years ended December 31, 2013 and 2012. We hereby consent to the incorporation by reference of said report in the Registration Statements of United Bancorp, Inc. on Forms S-8 (file No. 33-123036 effective February 28, 2005) and S-3 (file No. 333-136708 effective August 17, 2006).

/s/ BKD, LLP

Cincinnati, Ohio

March 19, 2014