Fair Value of Financial Instruments - Valuation techniques and inputs used (Details) - Fair Value, Inputs, Level 3 $ in Thousands	12 Months Ended
	Jun. 30, 2021 USD ($)
Private issue CMO
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	$ 154
Private issue CMO | Market comparable pricing | Comparability adjustment
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Impact to valuation from an increase in inputs on assets	Increase
Private issue CMO | Minimum | Market comparable pricing | Comparability adjustment
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	1.00%
Private issue CMO | Maximum | Market comparable pricing | Comparability adjustment
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	1.80%
Private issue CMO | Weighted Average | Market comparable pricing | Comparability adjustment
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	1.70%
Loans Held For Investment, at fair value
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	$ 1,874
Loans Held For Investment, at fair value | Relative value analysis | Broker quotes
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Impact to valuation from an increase in inputs on assets	Increase
Loans Held For Investment, at fair value | Relative value analysis | Credit risk factors
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Impact to valuation from an increase in inputs on assets	Decrease
Loans Held For Investment, at fair value | Minimum | Relative value analysis | Broker quotes
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	98.00%
Loans Held For Investment, at fair value | Minimum | Relative value analysis | Credit risk factors
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	1.30%
Loans Held For Investment, at fair value | Maximum | Relative value analysis | Broker quotes
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	104.00%
Loans Held For Investment, at fair value | Maximum | Relative value analysis | Credit risk factors
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	100.00%
Loans Held For Investment, at fair value | Weighted Average | Relative value analysis | Broker quotes
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	101.10%
Loans Held For Investment, at fair value | Weighted Average | Relative value analysis | Credit risk factors
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	4.30%
Non-performing loans | Relative value analysis
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	$ 980
Non-performing loans | Relative value analysis | Credit risk factors
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Impact to valuation from an increase in inputs on assets	Decrease
Non-performing loans | Discounted cash flow
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	$ 6,767
Non-performing loans | Discounted cash flow | Default rates.
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Impact to valuation from an increase in inputs on assets	Decrease
Non-performing loans | Minimum | Relative value analysis | Credit risk factors
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	20.00%
Non-performing loans | Minimum | Discounted cash flow | Discount rate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	5.00%
Non-performing loans | Maximum | Relative value analysis | Credit risk factors
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	30.00%
Non-performing loans | Maximum | Discounted cash flow | Discount rate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	8.80%
Non-performing loans | Weighted Average | Relative value analysis | Credit risk factors
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	28.30%
Non-performing loans | Weighted Average | Discounted cash flow | Discount rate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	5.40%
Mortgage servicing assets
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	$ 208
Mortgage servicing assets | Prepayment speed (CPR)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Impact to valuation from an increase in inputs on assets	Decrease
Mortgage servicing assets | Discount rate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Impact to valuation from an increase in inputs on assets	Decrease
Mortgage servicing assets | Minimum | Discounted cash flow | Prepayment speed (CPR)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	16.40%
Mortgage servicing assets | Minimum | Discounted cash flow | Discount rate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	9.00%
Mortgage servicing assets | Maximum | Discounted cash flow | Prepayment speed (CPR)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	60.00%
Mortgage servicing assets | Maximum | Discounted cash flow | Discount rate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	10.50%
Mortgage servicing assets | Weighted Average | Discounted cash flow | Prepayment speed (CPR)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	21.80%
Mortgage servicing assets | Weighted Average | Discounted cash flow | Discount rate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	9.10%
Unrealized gains and losses on Interest-Only Strips
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	$ 10
Unrealized gains and losses on Interest-Only Strips | Prepayment speed (CPR)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Impact to valuation from an increase in inputs on assets	Decrease
Unrealized gains and losses on Interest-Only Strips | Discount rate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Impact to valuation from an increase in inputs on assets	Decrease
Unrealized gains and losses on Interest-Only Strips | Discounted cash flow | Discount rate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	9.00%
Unrealized gains and losses on Interest-Only Strips | Minimum | Discounted cash flow | Prepayment speed (CPR)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	20.10%
Unrealized gains and losses on Interest-Only Strips | Maximum | Discounted cash flow | Prepayment speed (CPR)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	23.00%
Unrealized gains and losses on Interest-Only Strips | Weighted Average | Discounted cash flow | Prepayment speed (CPR)
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets Fair Value Measurement Input	22.80%