Loans Held for Investment - Schedule of loan forbearance related to COVID-19 hardship requests (Details) $ in Thousands	3 Months Ended
	Sep. 30, 2021 USD ($)
Accounts, Notes, Loans and Financing Receivable [Line Items]
Forbearance Granted, Number of Loans	67
Forbearance Granted, Amount	$ 27,769
Forbearance Completed, Number of Loans	66
Forbearance Completed, Amount	$ 27,461
Forbearance Remaining, Number of Loans	1
Forbearance Remaining, Amount	$ 308
% of Total Loans	0.04%
Weighted Avg. LTV	78.00%
Weighted Avg. FICO	653
Weighted Avg. Forbearance Period Granted	12 years
Mortgage loans, Single-family
Accounts, Notes, Loans and Financing Receivable [Line Items]
Forbearance Granted, Number of Loans	59
Forbearance Granted, Amount	$ 23,471
Forbearance Completed, Number of Loans	58
Forbearance Completed, Amount	$ 23,163
Forbearance Remaining, Number of Loans	1
Forbearance Remaining, Amount	$ 308
% of Total Loans	0.04%
Weighted Avg. LTV	78.00%
Weighted Avg. FICO	653
Weighted Avg. Forbearance Period Granted	12 years
Mortgage Loans, Multi Family
Accounts, Notes, Loans and Financing Receivable [Line Items]
Forbearance Granted, Number of Loans	5
Forbearance Granted, Amount	$ 2,308
Forbearance Completed, Number of Loans	5
Forbearance Completed, Amount	$ 2,308
Mortgage loans, Commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Forbearance Granted, Number of Loans	3
Forbearance Granted, Amount	$ 1,990
Forbearance Completed, Number of Loans	3
Forbearance Completed, Amount	$ 1,990