Loans and Allowance for Credit Losses on Loans - Breakdown Between Loans Identified as CDAs and Non-CDAs (Details) - USD ($) $ in Thousands	Mar. 31, 2022	Jun. 30, 2021
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	$ 2,699,538	$ 2,733,267
Commercial Loans
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	2,032,839	1,968,035
Commercial Loans | PPP
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	2,756	46,650
Commercial Loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	1,102,184	1,142,276
Commercial Loans | Construction and development
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	251,668	179,427
Commercial Loans | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	167,342	141,341
Commercial Loans | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	378,629	317,920
Commercial Loans | Municipal finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	130,260	140,421
Retail Consumer Loans
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	666,699	765,232
Retail Consumer Loans | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	347,945	406,549
Retail Consumer Loans | HELOCs - originated
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	128,445	130,225
Retail Consumer Loans | HELOCs - purchased
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	26,911	38,976
Retail Consumer Loans | Construction and land/lots
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	72,735	66,027
Retail Consumer Loans | Indirect auto finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	83,903	115,093
Retail Consumer Loans | Consumer
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	6,760	8,362
Residential Property
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	1,347	807
Total Collateral Value	2,285	1,160
Residential Property | Commercial Loans | PPP
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Residential Property | Commercial Loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Residential Property | Commercial Loans | Construction and development
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Residential Property | Commercial Loans | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Residential Property | Commercial Loans | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Residential Property | Commercial Loans | Municipal finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Residential Property | Retail Consumer Loans | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	1,347	807
Residential Property | Retail Consumer Loans | HELOCs - originated
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Residential Property | Retail Consumer Loans | HELOCs - purchased
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Residential Property | Retail Consumer Loans | Construction and land/lots
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Residential Property | Retail Consumer Loans | Indirect auto finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Residential Property | Retail Consumer Loans | Consumer
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Investment Property
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	3,501
Total Collateral Value	0	3,602
Investment Property | Commercial Loans | PPP
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Investment Property | Commercial Loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	3,421
Investment Property | Commercial Loans | Construction and development
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	80
Investment Property | Commercial Loans | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Investment Property | Commercial Loans | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Investment Property | Commercial Loans | Municipal finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Investment Property | Retail Consumer Loans | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Investment Property | Retail Consumer Loans | HELOCs - originated
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Investment Property | Retail Consumer Loans | HELOCs - purchased
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Investment Property | Retail Consumer Loans | Construction and land/lots
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Investment Property | Retail Consumer Loans | Indirect auto finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Investment Property | Retail Consumer Loans | Consumer
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	282	2,308
Total Collateral Value	288	2,723
Commercial Property | Commercial Loans | PPP
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property | Commercial Loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	282	2,308
Commercial Property | Commercial Loans | Construction and development
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property | Commercial Loans | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property | Commercial Loans | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property | Commercial Loans | Municipal finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property | Retail Consumer Loans | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property | Retail Consumer Loans | HELOCs - originated
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property | Retail Consumer Loans | HELOCs - purchased
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property | Retail Consumer Loans | Construction and land/lots
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property | Retail Consumer Loans | Indirect auto finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Commercial Property | Retail Consumer Loans | Consumer
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	1,311	25
Total Collateral Value	0	26
Business Assets | Commercial Loans | PPP
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets | Commercial Loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets | Commercial Loans | Construction and development
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets | Commercial Loans | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	1,311	25
Business Assets | Commercial Loans | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets | Commercial Loans | Municipal finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets | Retail Consumer Loans | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets | Retail Consumer Loans | HELOCs - originated
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets | Retail Consumer Loans | HELOCs - purchased
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets | Retail Consumer Loans | Construction and land/lots
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets | Retail Consumer Loans | Indirect auto finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Business Assets | Retail Consumer Loans | Consumer
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	0	0
Financial Assets Not Considered Collateral Dependent
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	2,696,598	2,726,626
Financial Assets Not Considered Collateral Dependent | Commercial Loans | PPP
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	2,756	46,650
Financial Assets Not Considered Collateral Dependent | Commercial Loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	1,101,902	1,136,547
Financial Assets Not Considered Collateral Dependent | Commercial Loans | Construction and development
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	251,668	179,347
Financial Assets Not Considered Collateral Dependent | Commercial Loans | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	166,031	141,316
Financial Assets Not Considered Collateral Dependent | Commercial Loans | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	378,629	317,920
Financial Assets Not Considered Collateral Dependent | Commercial Loans | Municipal finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	130,260	140,421
Financial Assets Not Considered Collateral Dependent | Retail Consumer Loans | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	346,598	405,742
Financial Assets Not Considered Collateral Dependent | Retail Consumer Loans | HELOCs - originated
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	128,445	130,225
Financial Assets Not Considered Collateral Dependent | Retail Consumer Loans | HELOCs - purchased
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	26,911	38,976
Financial Assets Not Considered Collateral Dependent | Retail Consumer Loans | Construction and land/lots
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	72,735	66,027
Financial Assets Not Considered Collateral Dependent | Retail Consumer Loans | Indirect auto finance
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	83,903	115,093
Financial Assets Not Considered Collateral Dependent | Retail Consumer Loans | Consumer
Accounts, Notes, Loans and Financing Receivable
Total loans receivable	$ 6,760	$ 8,362