Loans Held for Investment - Schedule of Gross Loans Held for Investment by Loan Types and Risk Category (Details) - USD ($) $ in Thousands	Jun. 30, 2022	Jun. 30, 2021
Loans and Leases Receivable, Gross	$ 937,970	$ 852,082
Mortgage loans, Single-family
Loans and Leases Receivable, Gross	378,234	268,272
Mortgage Loans, Multi Family
Loans and Leases Receivable, Gross	464,676	484,408
Mortgage loans, Commercial real estate
Loans and Leases Receivable, Gross	90,429	95,279
Construction
Loans and Leases Receivable, Gross	3,216	3,040
Mortgage Loans Other
Loans and Leases Receivable, Gross	123	139
Commercial business loans
Loans and Leases Receivable, Gross	1,206	849
Consumer loans
Loans and Leases Receivable, Gross	86	95
Pass
Loans and Leases Receivable, Gross	936,238	840,908
Pass | Mortgage loans, Single-family
Loans and Leases Receivable, Gross	376,502	258,217
Pass | Mortgage Loans, Multi Family
Loans and Leases Receivable, Gross	464,676	483,289
Pass | Mortgage loans, Commercial real estate
Loans and Leases Receivable, Gross	90,429	95,279
Pass | Construction
Loans and Leases Receivable, Gross	3,216	3,040
Pass | Mortgage Loans Other
Loans and Leases Receivable, Gross	123	139
Pass | Commercial business loans
Loans and Leases Receivable, Gross	1,206	849
Pass | Consumer loans
Loans and Leases Receivable, Gross	86	95
Special Mention
Loans and Leases Receivable, Gross	224	1,767
Special Mention | Mortgage loans, Single-family
Loans and Leases Receivable, Gross	224	1,767
Special Mention | Mortgage Loans, Multi Family
Loans and Leases Receivable, Gross	0	0
Special Mention | Mortgage loans, Commercial real estate
Loans and Leases Receivable, Gross	0	0
Special Mention | Construction
Loans and Leases Receivable, Gross	0	0
Special Mention | Mortgage Loans Other
Loans and Leases Receivable, Gross	0
Special Mention | Commercial business loans
Loans and Leases Receivable, Gross	0	0
Special Mention | Consumer loans
Loans and Leases Receivable, Gross	0	0
Substandard
Loans and Leases Receivable, Gross	1,508	9,407
Substandard | Mortgage loans, Single-family
Loans and Leases Receivable, Gross	1,508	8,288
Substandard | Mortgage Loans, Multi Family
Loans and Leases Receivable, Gross	0	1,119
Substandard | Mortgage loans, Commercial real estate
Loans and Leases Receivable, Gross	0	0
Substandard | Construction
Loans and Leases Receivable, Gross	0	0
Substandard | Mortgage Loans Other
Loans and Leases Receivable, Gross	0
Substandard | Commercial business loans
Loans and Leases Receivable, Gross	0	0
Substandard | Consumer loans
Loans and Leases Receivable, Gross	$ 0	$ 0