Loans and Allowance for Credit Losses - Classes of loans (Details) $ in Thousands	12 Months Ended
	Jun. 30, 2024 USD ($) loan	Jun. 30, 2023 USD ($) loan	Jun. 30, 2022 USD ($)
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans before fees gross	$ 4,059,081	$ 3,978,393
Loans in Process	(209,046)	(359,196)
Deferred loan fees, net	(232)	(299)
Allowance for credit losses	(52,516)	(47,820)	$ (33,192)
Total loans	$ 3,797,287	$ 3,571,078
Number of purchased participation loans | loan	71	86
Purchased participation loans	$ 178,500	$ 155,600
Residential Real Estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans before fees gross	1,185,692	1,133,417
Allowance for credit losses	(15,839)	(15,641)	(8,908)
Construction Real Estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans before fees gross	438,134	550,052
Allowance for credit losses	(2,201)	(2,664)	(2,220)
Commercial Real Estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans before fees gross	1,622,365	1,562,379
Allowance for credit losses	(26,460)	(22,838)	(16,838)
Consumer
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans before fees gross	144,598	133,515
Allowance for credit losses	(1,102)	(909)	(710)
Commercial
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans before fees gross	668,292	599,030
Allowance for credit losses	$ (6,914)	$ (5,768)	$ (4,516)