Organization and Summary of Significant Accounting Policies - New Accounting Pronouncements (Details) - USD ($)		12 Months Ended
	Jul. 01, 2020	Jun. 30, 2023	Jun. 30, 2022	Jun. 30, 2021	Jun. 30, 2020
Allowance for credit losses for purchased credit deteriorated (PCD)		$ 17,100,000	$ 1,500,000	$ 1,000,000.0
Loans receivable		3,571,078,000	2,686,198,000
Total allowance for credit losses on loans		47,820,000	33,192,000	33,222,000
Total allowance for credit losses on loans					$ 25,139,000
Total allowance for credit losses on off-balance sheet credit exposures		6,288,000	3,358,000	1,805,000	1,959,000
Accounting Standards Update 2016-13
Loans receivable					2,141,929,000
Total allowance for credit losses on loans					25,139,000
Total allowance for credit losses on off-balance sheet credit exposures					1,959,000
As reported under ASU 2016-13
Adjustment to the reserve for unfunded commitments					268,000
Retained earnings	$ 7,200,000
As reported under ASU 2016-13 | Accounting Standards Update 2016-13
Loans receivable	2,142,363,000
Total allowance for credit losses on loans	34,472,000
Total allowance for credit losses on off-balance sheet credit exposures	2,227,000
Impact of adoption ASU 2016-13
Increase to ACL					8,900,000
Allowance for credit losses for purchased credit deteriorated (PCD)			1,121,000		434,000
Impact of adoption ASU 2016-13 | Accounting Standards Update 2016-13
Loans receivable	434,000
Total allowance for credit losses on loans	9,333,000			9,333,000
Total allowance for credit losses on off-balance sheet credit exposures	268,000			268,000
Impact of adoption ASU 2016-13 | Purchased credit deteriorated ("PCD") loans
Increase to ACL	434,000
Residential and commercial real estate loans | Purchased credit deteriorated ("PCD") loans
Loans receivable	434,000
Residential Real Estate
Total allowance for credit losses on loans		15,641,000	8,908,000	11,192,000
Total allowance for credit losses on loans					4,875,000
Total allowance for credit losses on off-balance sheet credit exposures		71,000	58,000	37,000	19,000
Residential Real Estate | Accounting Standards Update 2016-13
Total allowance for credit losses on loans					4,875,000
Residential Real Estate | As reported under ASU 2016-13 | Accounting Standards Update 2016-13
Total allowance for credit losses on loans	8,396,000
Residential Real Estate | Impact of adoption ASU 2016-13
Allowance for credit losses for purchased credit deteriorated (PCD)			96,000
Residential Real Estate | Impact of adoption ASU 2016-13 | Accounting Standards Update 2016-13
Total allowance for credit losses on loans	3,521,000			3,521,000
Total allowance for credit losses on off-balance sheet credit exposures				35,000
Construction Real Estate
Total allowance for credit losses on loans		2,664,000	2,220,000	2,170,000
Total allowance for credit losses on loans					2,010,000
Total allowance for credit losses on off-balance sheet credit exposures		4,809,000	2,178,000	502,000	769,000
Construction Real Estate | Accounting Standards Update 2016-13
Total allowance for credit losses on loans					2,010,000
Construction Real Estate | As reported under ASU 2016-13 | Accounting Standards Update 2016-13
Total allowance for credit losses on loans	1,889,000
Construction Real Estate | Impact of adoption ASU 2016-13
Allowance for credit losses for purchased credit deteriorated (PCD)			12,000
Construction Real Estate | Impact of adoption ASU 2016-13 | Accounting Standards Update 2016-13
Total allowance for credit losses on loans	(121,000)			(121,000)
Total allowance for credit losses on off-balance sheet credit exposures				(167,000)
Commercial Real Estate
Total allowance for credit losses on loans		22,838,000	16,838,000	14,535,000
Total allowance for credit losses on loans					12,132,000
Total allowance for credit losses on off-balance sheet credit exposures		475,000	421,000	188,000	172,000
Commercial Real Estate | Accounting Standards Update 2016-13
Total allowance for credit losses on loans					12,132,000
Commercial Real Estate | As reported under ASU 2016-13 | Accounting Standards Update 2016-13
Total allowance for credit losses on loans	15,988,000
Commercial Real Estate | Impact of adoption ASU 2016-13
Allowance for credit losses for purchased credit deteriorated (PCD)			628,000
Commercial Real Estate | Impact of adoption ASU 2016-13 | Accounting Standards Update 2016-13
Total allowance for credit losses on loans	3,856,000			3,856,000
Total allowance for credit losses on off-balance sheet credit exposures				95,000
Consumer loans
Total allowance for credit losses on loans		909,000	710,000	916,000
Total allowance for credit losses on loans					1,182,000
Total allowance for credit losses on off-balance sheet credit exposures		73,000	61,000	218,000	153,000
Consumer loans | Accounting Standards Update 2016-13
Total allowance for credit losses on loans					1,182,000
Consumer loans | As reported under ASU 2016-13 | Accounting Standards Update 2016-13
Total allowance for credit losses on loans	2,247,000
Consumer loans | Impact of adoption ASU 2016-13
Allowance for credit losses for purchased credit deteriorated (PCD)			164,000
Consumer loans | Impact of adoption ASU 2016-13 | Accounting Standards Update 2016-13
Total allowance for credit losses on loans	1,065,000			1,065,000
Total allowance for credit losses on off-balance sheet credit exposures				197,000
Commercial loans
Total allowance for credit losses on loans		5,768,000	4,516,000	4,409,000
Total allowance for credit losses on loans					4,940,000
Total allowance for credit losses on off-balance sheet credit exposures		$ 860,000	640,000	860,000	846,000
Commercial loans | Accounting Standards Update 2016-13
Total allowance for credit losses on loans					$ 4,940,000
Commercial loans | As reported under ASU 2016-13 | Accounting Standards Update 2016-13
Total allowance for credit losses on loans	5,952,000
Commercial loans | Impact of adoption ASU 2016-13
Allowance for credit losses for purchased credit deteriorated (PCD)			$ 221,000
Commercial loans | Impact of adoption ASU 2016-13 | Accounting Standards Update 2016-13
Total allowance for credit losses on loans	$ 1,012,000			1,012,000
Total allowance for credit losses on off-balance sheet credit exposures				$ 108,000