Loans and Allowance for Credit Losses on Loans - Schedule of Accounts, Notes, Loans and Financing Receivable (Details) - USD ($) $ in Thousands	Mar. 31, 2022	Dec. 31, 2021	Jun. 30, 2021	Mar. 31, 2021	Dec. 31, 2020	Jun. 30, 2020
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	$ 2,699,538		$ 2,733,267
Allowance for credit losses on loans	(31,034)	$ (30,933)	(35,468)	$ (36,059)	$ (39,844)	$ (28,072)
Loans, net	2,668,504		2,697,799
Accrued interest receivable	7,427		7,339
Commercial Loans
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	2,032,839		1,968,035
Allowance for credit losses on loans	(22,322)	(22,968)	(24,746)	(23,398)	(24,899)	(21,116)
Commercial Loans | PPP
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	2,756		46,650
Allowance for credit losses on loans	0		0
Commercial Loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	1,102,184		1,142,276
Allowance for credit losses on loans	(9,157)		(13,282)
Commercial Loans | Construction and development
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	251,668		179,427
Allowance for credit losses on loans	(3,680)		(1,801)
Commercial Loans | Commercial and industrial
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	167,342		141,341
Allowance for credit losses on loans	(2,904)		(2,592)
Commercial Loans | Equipment finance
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	378,629		317,920
Allowance for credit losses on loans	(6,284)		(6,537)
Commercial Loans | Municipal finance
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	130,260		140,421
Allowance for credit losses on loans	(297)		(534)
Retail Consumer Loans
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	666,699		765,232
Allowance for credit losses on loans	(8,712)	$ (7,965)	(10,722)	$ (12,661)	$ (14,945)	$ (6,956)
Retail Consumer Loans | One-to-four family
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	347,945		406,549
Allowance for credit losses on loans	(4,400)		(5,409)
Retail Consumer Loans | HELOCs - originated
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	128,445		130,225
Allowance for credit losses on loans	(1,409)		(1,512)
Retail Consumer Loans | HELOCs - purchased
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	26,911		38,976
Allowance for credit losses on loans	(295)		(452)
Retail Consumer Loans | Construction and land/lots
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	72,735		66,027
Allowance for credit losses on loans	(903)		(812)
Retail Consumer Loans | Indirect auto finance
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	83,903		115,093
Allowance for credit losses on loans	(1,586)		(2,367)
Retail Consumer Loans | Consumer
Accounts, Notes, Loans and Financing Receivable
Total loans, net of deferred loan fees and costs	6,760		8,362
Allowance for credit losses on loans	$ (119)		$ (170)