Investment Securities - Schedule of amortized cost and estimated fair value of Held to maturity investments (Details) - USD ($) $ in Thousands	Sep. 30, 2022		Jun. 30, 2022
Held to maturity
Amortized Cost	$ 176,162		$ 185,745
Gross Unrealized Gains	7		74
Gross Unrealized (Losses)	(21,663)		(14,095)
Estimated Fair Value	154,506		171,724
Carrying Value	176,162		185,745
U.S. government sponsored enterprise MBS
Held to maturity
Amortized Cost	171,331	[1]	180,492
Gross Unrealized Gains	6	[1]	63
Gross Unrealized (Losses)	(21,346)	[1]	(13,945)
Estimated Fair Value	149,991	[1]	166,610
U.S. government sponsored enterprise CMO
Held to maturity
Amortized Cost	3,911	[2]	3,913
Gross Unrealized Gains	0	[2]	0
Gross Unrealized (Losses)	(317)	[2]	(150)
Estimated Fair Value	3,594	[2]	3,763
U.S. SBA securities
Held to maturity
Amortized Cost	720	[3]	940
Gross Unrealized Gains	1	[3]	11
Gross Unrealized (Losses)	0	[3]	0
Estimated Fair Value	721	[3]	951
Certificate of deposits
Held to maturity
Amortized Cost	200		400
Gross Unrealized Gains	0		0
Gross Unrealized (Losses)	0		0
Estimated Fair Value	$ 200		$ 400

[1] Mortgage-Backed Securities (“MBS”).

[2] Collateralized Mortgage Obligations (“CMO”).

[3] Small Business Administration (“SBA”).