Loans - Schedule of Accounts, Notes, Loans and Financing Receivable (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Jul. 01, 2020	Jun. 30, 2020	Sep. 30, 2019	Jun. 30, 2019
Accounts, Notes, Loans and Financing Receivable
Total loans	$ 2,769,396		$ 2,768,930
Deferred loan fees, net	0		189
Total loans, net of deferred loan costs	2,769,396		2,769,119
Allowance for credit losses	(43,132)	$ (28,072)	(28,072)	$ (21,314)	$ (21,429)
Total loans	2,726,264		2,741,047
Commercial Loans
Accounts, Notes, Loans and Financing Receivable
Total loans	1,895,391		1,861,588
Total loans, net of deferred loan costs	1,895,391
Allowance for credit losses	(25,199)	(21,116)	(21,116)	(15,392)	(14,809)
Commercial Loans | Paycheck Protection Program
Accounts, Notes, Loans and Financing Receivable
Total loans	80,816		80,697
Total loans, net of deferred loan costs	80,816
Allowance for credit losses	0		0
Commercial Loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Total loans	1,068,255		1,052,906
Total loans, net of deferred loan costs	1,068,255
Allowance for credit losses	(12,005)		(11,805)
Commercial Loans | Construction and development
Accounts, Notes, Loans and Financing Receivable
Total loans	216,757		215,934
Total loans, net of deferred loan costs	216,757
Allowance for credit losses	(2,736)		(3,608)
Commercial Loans | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Total loans	148,413		154,825
Total loans, net of deferred loan costs	148,413
Allowance for credit losses	(3,580)		(2,199)
Commercial Loans | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Total loans	250,813		229,239
Total loans, net of deferred loan costs	250,813
Allowance for credit losses	(6,439)		(2,807)
Commercial Loans | Municipal finance
Accounts, Notes, Loans and Financing Receivable
Total loans	130,337		127,987
Total loans, net of deferred loan costs	130,337
Allowance for credit losses	(438)		(697)
Retail Consumer Loans
Accounts, Notes, Loans and Financing Receivable
Total loans	874,005		907,342
Total loans, net of deferred loan costs	874,005
Allowance for credit losses	(17,933)	$ (6,956)	(6,956)	$ (5,728)	$ (6,419)
Retail Consumer Loans | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Total loans	459,285		473,693
Total loans, net of deferred loan costs	459,285
Allowance for credit losses	(9,969)		(2,469)
Retail Consumer Loans | HELOCs - originated
Accounts, Notes, Loans and Financing Receivable
Total loans	135,885		137,447
Total loans, net of deferred loan costs	135,885
Allowance for credit losses	(2,016)		(1,344)
Retail Consumer Loans | HELOCs - purchased
Accounts, Notes, Loans and Financing Receivable
Total loans	61,535		71,781
Total loans, net of deferred loan costs	61,535
Allowance for credit losses	(932)		(430)
Retail Consumer Loans | Construction and land/lots
Accounts, Notes, Loans and Financing Receivable
Total loans	78,799		81,859
Total loans, net of deferred loan costs	78,799
Allowance for credit losses	(1,599)		(1,442)
Retail Consumer Loans | Indirect auto finance
Accounts, Notes, Loans and Financing Receivable
Total loans	128,466		132,303
Total loans, net of deferred loan costs	128,466
Allowance for credit losses	(3,139)		(1,136)
Retail Consumer Loans | Consumer
Accounts, Notes, Loans and Financing Receivable
Total loans	10,035		10,259
Total loans, net of deferred loan costs	10,035
Allowance for credit losses	$ (279)		$ (135)