Loans and Allowance for Credit Losses on Loans - Schedule of Past Due Financing Receivables (Details) - USD ($) $ in Thousands	Mar. 31, 2022	Jun. 30, 2021
Financing Receivable, Past Due [Line Items]
Past Due	$ 3,347	$ 7,115
Current	2,696,191	2,726,152
Total Loans	2,699,538	2,733,267
30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	913	3,313
90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	2,434	3,802
Commercial Loans
Financing Receivable, Past Due [Line Items]
Total Loans	2,032,839	1,968,035
Commercial Loans | PPP
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Current	2,756	46,650
Total Loans	2,756	46,650
Commercial Loans | 30-89 Days | PPP
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Commercial Loans | 90 Days+ | PPP
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Commercial Loans | Commercial real estate
Financing Receivable, Past Due [Line Items]
Past Due	247	2,076
Current	1,101,937	1,140,200
Total Loans	1,102,184	1,142,276
Commercial Loans | Commercial real estate | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	396
Commercial Loans | Commercial real estate | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	247	1,680
Commercial Loans | Construction and development
Financing Receivable, Past Due [Line Items]
Past Due	246	37
Current	251,422	179,390
Total Loans	251,668	179,427
Commercial Loans | Construction and development | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Commercial Loans | Construction and development | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	246	37
Commercial Loans | Commercial and industrial
Financing Receivable, Past Due [Line Items]
Past Due	67	653
Current	167,275	140,688
Total Loans	167,342	141,341
Commercial Loans | Commercial and industrial | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	634
Commercial Loans | Commercial and industrial | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	67	19
Commercial Loans | Equipment finance
Financing Receivable, Past Due [Line Items]
Past Due	98	347
Current	378,531	317,573
Total Loans	378,629	317,920
Commercial Loans | Equipment finance | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	65	0
Commercial Loans | Equipment finance | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	33	347
Commercial Loans | Municipal finance
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Current	130,260	140,421
Total Loans	130,260	140,421
Commercial Loans | Municipal finance | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Commercial Loans | Municipal finance | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Retail Consumer Loans
Financing Receivable, Past Due [Line Items]
Total Loans	666,699	765,232
Retail Consumer Loans | One-to-four family
Financing Receivable, Past Due [Line Items]
Past Due	1,676	2,236
Current	346,269	404,313
Total Loans	347,945	406,549
Retail Consumer Loans | One-to-four family | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	347	1,112
Retail Consumer Loans | One-to-four family | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	1,329	1,124
Retail Consumer Loans | HELOCs - originated
Financing Receivable, Past Due [Line Items]
Past Due	206	476
Current	128,239	129,749
Total Loans	128,445	130,225
Retail Consumer Loans | HELOCs - originated | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	28	290
Retail Consumer Loans | HELOCs - originated | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	178	186
Retail Consumer Loans | HELOCs - purchased
Financing Receivable, Past Due [Line Items]
Past Due	142	277
Current	26,769	38,699
Total Loans	26,911	38,976
Retail Consumer Loans | HELOCs - purchased | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	142	198
Retail Consumer Loans | HELOCs - purchased | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	0	79
Retail Consumer Loans | Construction and land/lots
Financing Receivable, Past Due [Line Items]
Past Due	140	41
Current	72,595	65,986
Total Loans	72,735	66,027
Retail Consumer Loans | Construction and land/lots | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	6
Retail Consumer Loans | Construction and land/lots | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	140	35
Retail Consumer Loans | Indirect auto finance
Financing Receivable, Past Due [Line Items]
Past Due	463	558
Current	83,440	114,535
Total Loans	83,903	115,093
Retail Consumer Loans | Indirect auto finance | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	307	299
Retail Consumer Loans | Indirect auto finance | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	156	259
Retail Consumer Loans | Consumer
Financing Receivable, Past Due [Line Items]
Past Due	62	414
Current	6,698	7,948
Total Loans	6,760	8,362
Retail Consumer Loans | Consumer | 30-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	24	378
Retail Consumer Loans | Consumer | 90 Days+
Financing Receivable, Past Due [Line Items]
Past Due	$ 38	$ 36