Organization and Summary of Significant Accounting Policies - Goodwill and Intangible Assets (Details) - USD ($)	9 Months Ended	12 Months Ended
	Mar. 31, 2023	Jun. 30, 2022
Finite-Lived Intangible Assets [Line Items]
Impairment loss on goodwill	$ 0	$ 0
Core deposit intangible assets, amortization method	using the straight line method
Core Deposits
Finite-Lived Intangible Assets [Line Items]
Intangible assets, gross	$ 39,100,000	17,000,000.0
Intangibles assets, accumulated amortization	13,100,000	11,500,000
Remainder of fiscal 2023	1.0
2024	4,100,000
2025	3,500,000
2026	3.0
2027	2,700,000
Thereafter	14,200,000
Impairment of intangible assets		0
Other identifiable intangibles
Finite-Lived Intangible Assets [Line Items]
Intangible assets, gross	6,400,000	3,800,000
Intangibles assets, accumulated amortization	3,900,000	3,800,000
Impairment of intangible assets	0
Mortgage and SBA servicing rights
Finite-Lived Intangible Assets [Line Items]
Intangible assets, net	$ 2,600,000	$ 2,700,000
Minimum | Core Deposits
Finite-Lived Intangible Assets [Line Items]
Intangible assets, amortization period	5 years
Maximum | Core Deposits
Finite-Lived Intangible Assets [Line Items]
Intangible assets, amortization period	10 years