Derivative and Other Financial Instruments with Off-Balance Sheet Risks - Schedule of Allowance for Loan Losses of Undisbursed Funds and Commitments on Loans Held for Investment (Details) - USD ($) $ in Thousands	3 Months Ended
	Sep. 30, 2020	Sep. 30, 2019
Allowance for Loan and Lease Losses [Roll Forward]
Balance, beginning of the period	$ 8,265	$ 7,076
Provision (recovery)	220	(181)
Balance, end of the period	8,490	6,929
Loan Commitments to Originate
Allowance for Loan and Lease Losses [Roll Forward]
Balance, beginning of the period	126	141
Provision (recovery)	(22)	2
Balance, end of the period	$ 104	$ 143