Fair Value of Financial Instruments - Schedule of Quantitative Information About Level 3 Fair Value Measurements (Details) - Nonrecurring Measurements - USD ($) $ in Thousands	12 Months Ended
	Jun. 30, 2020	Jun. 30, 2019
Fair Value Inputs, Assets, Quantitative Information [Line Items] (Deprecated 2018-01-31)
Assets, fair value	$ 9,265	$ 10,875
Impaired loans, net
Fair Value Inputs, Assets, Quantitative Information [Line Items] (Deprecated 2018-01-31)
Assets, fair value	$ 9,168
Weighted Average	27.00%
REO
Fair Value Inputs, Assets, Quantitative Information [Line Items] (Deprecated 2018-01-31)
Assets, fair value	$ 97
Weighted Average	8.00%
Minimum | Impaired loans, net
Fair Value Inputs, Assets, Quantitative Information [Line Items] (Deprecated 2018-01-31)
Weighted Average	0.00%
Minimum | REO
Fair Value Inputs, Assets, Quantitative Information [Line Items] (Deprecated 2018-01-31)
Weighted Average	8.00%
Maximum | Impaired loans, net
Fair Value Inputs, Assets, Quantitative Information [Line Items] (Deprecated 2018-01-31)
Weighted Average	63.00%
Valuation Technique, Discounted Cash Flow | Minimum | Impaired loans, net
Fair Value Inputs, Assets, Quantitative Information [Line Items] (Deprecated 2018-01-31)
Weighted Average	2.00%
Valuation Technique, Discounted Cash Flow | Maximum | Impaired loans, net
Fair Value Inputs, Assets, Quantitative Information [Line Items] (Deprecated 2018-01-31)
Weighted Average	3.00%