Loans Held for Investment - Schedule of Restructured Loans by Type, Net of Individually Evaluated Allowances (Details) - USD ($) $ in Thousands	Jun. 30, 2022	Jun. 30, 2021
Financing Receivable, Impaired [Line Items]
Restructured Loans, Allowance for Loan Losses	$ (38)	$ (384)
Restructured Loans, Unpaid Principal Balance	4,508	8,608
Restructured Loans, Related Charge-offs	0	(365)
Restructured Loans, Recorded Investment	4,508	8,243
Restructured loans, net investment	4,470	7,859
Mortgage loans, Single-family
Financing Receivable, Impaired [Line Items]
Restructured Loans, With Related Allowance, Unpaid Principal Balance	760	7,151
Restructured Loans, With Related Allowance, Related Charge-offs	0
Restructured Loans, With a Related Allowance, Recorded Investment	760	7,151
Restructured Loans, Allowance for Loan Losses	(38)	(384)
Restructured loans, with a related allowance, net investment	722	6,767
Restructured Loans, Without a Related Allowance, Unpaid Principal Balance	3,748	1,457
Restructured Loans, Without a Related Allowance, Related Charge-offs	0	(365)
Restructured Loans, Without a Related Allowance, Recorded Investment	3,748	1,092
Restructured Loans, Without a Related Allowance, Net Investment	3,748	1,092
Restructured Loans, Unpaid Principal Balance	4,508	8,608
Restructured Loans, Related Charge-offs	0	(365)
Restructured Loans, Recorded Investment	4,508	8,243
Restructured loans, net investment	$ 4,470	$ 7,859