Investment Securities - Schedule of amortized cost and estimated fair value of Held to maturity investments (Details) - USD ($) $ in Thousands	Jun. 30, 2024		Jun. 30, 2023
Held to maturity
Amortized Cost	$ 130,051		$ 154,337
Gross Unrealized Gains	76		0
Gross Unrealized (Losses)	(15,734)		(18,796)
Estimated Fair Value	114,393		135,541
Carrying Value	130,051		154,337
Mortgage-Backed Security, Issued by US Government-Sponsored Enterprise [Member]
Held to maturity
Amortized Cost	125,883	[1]	149,803
Gross Unrealized Gains	76	[1]	0
Gross Unrealized (Losses)	(15,481)	[1]	(18,459)
Estimated Fair Value	110,478	[1]	131,344
Carrying Value	125,883	[1]	149,803
U.S. government sponsored enterprise CMO
Held to maturity
Amortized Cost	3,713	[2]	3,883
Gross Unrealized Gains	0	[2]	0
Gross Unrealized (Losses)	(253)	[2]	(336)
Estimated Fair Value	3,460	[2]	3,547
Carrying Value	3,713	[2]	3,883
U.S. SBA securities
Held to maturity
Amortized Cost	455	[3]	651
Gross Unrealized Gains	0	[3]	0
Gross Unrealized (Losses)	0	[3]	(1)
Estimated Fair Value	455	[3]	650
Carrying Value	$ 455	[3]	$ 651

[1] Mortgage-backed securities (“MBS”)

[2] Collateralized mortgage obligations (“CMO”)

[3] Small Business Administration ("SBA")