Derivative and Other Financial Instruments with Off-Balance Sheet Risks - Schedule of Allowance for Loan Losses of Undisbursed Funds and Commitments on Loans Held for Investment (Details) - USD ($) $ in Thousands	12 Months Ended
	Jun. 30, 2021	Jun. 30, 2020
Allowance for Loan and Lease Losses [Roll Forward]
Allowance at beginning of period	$ 8,265	$ 7,076
Provision (recovery)	(708)	1,119
Allowance for loan losses, end of period	7,587	8,265
Loan Commitments to Originate
Allowance for Loan and Lease Losses [Roll Forward]
Allowance at beginning of period	126	141
Provision (recovery)	1	(15)
Allowance for loan losses, end of period	$ 127	$ 126