Derivative and Other Financial Instruments with Off-Balance Sheet Risks - Schedule of Allowance for Loan Losses of Undisbursed Funds and Commitments on Loans Held for Investment (Details) - USD ($) $ in Thousands	3 Months Ended
	Sep. 30, 2021	Sep. 30, 2020
Allowance for Loan and Lease Losses [Roll Forward]
Allowance at beginning of period	$ 7,587	$ 8,265
Provision (recovery)	(339)	220
Allowance for loan losses, end of period	7,413	8,490
Commitments to extend credit on loans to be held for sale
Allowance for Loan and Lease Losses [Roll Forward]
Allowance at beginning of period	127	126
Provision (recovery)	(23)	(22)
Allowance for loan losses, end of period	$ 104	$ 104