Consolidated Statements of Changes in Stockholders' Equity - USD ($) $ in Thousands	Total	Common Stock	Additional Paid In Capital	Retained Earnings	Unearned ESOP Shares	Accumulated Other Comprehensive Income (Loss)	Cumulative-effect adjustment on the change in accounting for share-based payments	Cumulative-effect adjustment on the change in accounting for share-based payments Retained Earnings
Beginning balance at Jun. 30, 2017	$ 397,647	$ 190	$ 213,459	$ 191,660	$ (7,935)	$ 273	$ 680	$ 680
Beginning balance (in shares) at Jun. 30, 2017		18,967,875
Increase (Decrease) in Stockholders' Equity
Net income	$ 8,235			8,235
Granted restricted stock (in shares)	55,200
Forfeited restricted stock (in shares)		(6,600)
Retired stock	$ (494)		(494)
Retired stock (in shares)		(19,007)
Exercised stock options	651	$ 1	650
Exercised stock options (in shares)		44,200
Stock option expense	1,758		1,758
Restricted stock expense	1,269		1,269
ESOP shares allocated	1,367		838		529
Other comprehensive loss	(1,871)					(1,871)
Ending balance at Jun. 30, 2018	409,242	$ 191	217,480	200,575	(7,406)	(1,598)
Ending balance, shares (in shares) at Jun. 30, 2018		19,041,668
Increase (Decrease) in Stockholders' Equity
Net income	27,146			27,146
Cash dividends declared on common stock, $0.27/common share	(3,176)			(3,176)
Stock repurchased	$ (30,638)	$ (11)	(30,627)
Stock repurchased (in shares)		(1,149,785)
Granted restricted stock (in shares)	23,625
Forfeited restricted stock (in shares)		(4,300)
Retired stock	$ (205)		(205)
Retired stock (in shares)		(7,414)
Exercised stock options	1,173	$ 0	1,173
Exercised stock options (in shares)		80,311
Stock option expense	736		736
Restricted stock expense	865		865
ESOP shares allocated	1,422		893		529
Other comprehensive loss	2,331					2,331
Ending balance at Jun. 30, 2019	$ 408,896	$ 180	190,315	224,545	(6,877)	733
Ending balance, shares (in shares) at Jun. 30, 2019	17,984,105	17,984,105
Increase (Decrease) in Stockholders' Equity
Net income	$ 22,783			22,783
Cash dividends declared on common stock, $0.27/common share	(4,552)			(4,552)
Stock repurchased	$ (24,484)	$ (12)	(24,472)
Stock repurchased (in shares)		(1,114,094)
Granted restricted stock (in shares)	56,306
Forfeited restricted stock (in shares)		(3,400)
Retired stock	$ (222)		(222)
Retired stock (in shares)		(8,474)
Exercised stock options	1,541	$ 2	1,539
Exercised stock options (in shares)		106,914
Stock option expense	717		717
Restricted stock expense	1,105		1,105
ESOP shares allocated	1,195		666		529
Other comprehensive loss	1,284					1,284
Ending balance at Jun. 30, 2020	$ 408,263	$ 170	$ 169,648	$ 242,776	$ (6,348)	$ 2,017
Ending balance, shares (in shares) at Jun. 30, 2020	17,021,372	17,021,357