Organization and Summary of Significant Accounting Policies (Details 2)	12 Months Ended
	Jun. 30, 2019 USD ($) location	Jun. 30, 2018 USD ($)	Jun. 30, 2017 USD ($)
Accounts, Notes, Loans and Financing Receivable [Line Items]
Number of banking locations | location	13
Portion of Loans Held for Investment	63.00%	65.00%
Loans serviced under MPF program	$ 9,700,000	$ 11,800,000
Recourse liability	250,000	283,000	$ 305,000
Estimated deferred tax asset	3,539,000	4,168,000
Loans serviced for other investors
Accounts, Notes, Loans and Financing Receivable [Line Items]
Recourse liability	200,000	200,000
Mortgage Partnership Finance (MPF) Program
Accounts, Notes, Loans and Financing Receivable [Line Items]
Recourse liability	50,000	83,000
Provident Bank Mortgage (PBM)
Accounts, Notes, Loans and Financing Receivable [Line Items]
Recourse liability	25,000	113,000
Loan sale premium refunds	96,000	648,000
Provident Bank Mortgage (PBM) | Mortgage loans, Single-family
Accounts, Notes, Loans and Financing Receivable [Line Items]
Repurchases of single-family loans	$ 948,000	$ 602,000