Loans - Schedule of Past Due Loans Still Accruing and Nonaccruing Interest (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Jun. 30, 2019
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	$ 15,923	$ 10,358
90 Days & still accruing	0	0
Purchased Credit Impaired (PCI) Loans
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	965	1,344
Retail Consumer Loans | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	3,582	3,223
90 Days & still accruing	0	0
Retail Consumer Loans | HELOCs - originated
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	531	372
90 Days & still accruing	0	0
Retail Consumer Loans | HELOCs - purchased
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	662	666
90 Days & still accruing	0	0
Retail Consumer Loans | Construction and land/lots
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	37	6
90 Days & still accruing	0	0
Retail Consumer Loans | Indirect auto finance
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	668	463
90 Days & still accruing	0	0
Retail Consumer Loans | Consumer
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	49	21
90 Days & still accruing	0	0
Commercial Loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	8,869	3,559
90 Days & still accruing	0	0
Commercial Loans | Construction and development
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	465	1,357
90 Days & still accruing	0	0
Commercial Loans | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	259	307
90 Days & still accruing	0	0
Commercial Loans | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Nonaccruing	801	384
90 Days & still accruing	$ 0	$ 0