Derivative and Other Financial Instruments with Off-Balance Sheet Risks - Schedule of Allowance for Loan Losses of Undisbursed Funds and Commitments on Loans Held for Investment (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Dec. 31, 2020	Dec. 31, 2019	Dec. 31, 2020	Dec. 31, 2019
Allowance for Loan and Lease Losses [Roll Forward]
Balance, beginning of the period	$ 8,490	$ 6,929	$ 8,265	$ 7,076
Provision (recovery)	39	(22)	259	(203)
Balance, end of the period	8,538	6,921	8,538	6,921
Loan Commitments to Originate
Allowance for Loan and Lease Losses [Roll Forward]
Balance, beginning of the period	104	143	126	141
Provision (recovery)	(3)	(5)	(25)	(3)
Balance, end of the period	$ 101	$ 138	$ 101	$ 138