Premises and Equipment - Property, Plant and Equipment (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Jun. 30, 2019
Property, Plant and Equipment [Abstract]
Land	$ 20,785	$ 19,730
Land held under capital lease(1)		2,052
Office buildings	59,333	58,952
Furniture, fixtures and equipment	15,724	15,918
Total	95,842	96,652
Less accumulated depreciation	(37,380)	(35,601)
Premises and equipment, net	$ 58,462	$ 61,051

Amount before accumulated depreciation of building structures held for productive use including addition, improvement, or renovation to the structure, including, but not limited to, interior masonry, interior flooring, electrical, and plumbing.

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 10
-Section 45
-Paragraph 4
-Subparagraph (f)
-URI http://asc.fasb.org/extlink&oid=121566466&loc=d3e6812-107765

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 360
-SubTopic 10
-Section 50
-Paragraph 1
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=6391035&loc=d3e2868-110229

+ Details

Name:	us-gaap_BuildingsAndImprovementsGross
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount before accumulated depreciation of leased physical assets used in the normal conduct of business to produce goods and services.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/otherTransitionRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 840
-SubTopic 30
-Section 45
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=121569800&loc=d3e45014-112735

+ Details

Name:	us-gaap_CapitalLeasedAssetsGross
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount before accumulated depreciation of equipment commonly used in offices and stores that have no permanent connection to the structure of a building or utilities. Examples include, but are not limited to, desks, chairs, tables, and bookcases.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 360
-SubTopic 10
-Section 50
-Paragraph 1
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=6391035&loc=d3e2868-110229

+ Details

Name:	us-gaap_FurnitureAndFixturesGross
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount before accumulated depletion of real estate held for productive use, excluding land held for sale.

+ References

+ Details

Name:	us-gaap_Land
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- References

No definition available.

+ Details

Name:	us-gaap_PropertyPlantAndEquipmentAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Amount after accumulated depreciation, depletion and amortization of physical assets used in the normal conduct of business to produce goods and services and not intended for resale. Examples include, but are not limited to, land, buildings, machinery and equipment, office equipment, and furniture and fixtures.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 10
-Section S99
-Paragraph 1
-Subparagraph (SX 210.5-02(14))
-URI http://asc.fasb.org/extlink&oid=120391452&loc=d3e13212-122682

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 360
-SubTopic 10
-Section 50
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=6391035&loc=d3e2868-110229

Reference 3: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 944
-SubTopic 210
-Section S99
-Paragraph 1
-Subparagraph (SX 210.7-03(a)(8))
-URI http://asc.fasb.org/extlink&oid=120400017&loc=d3e572229-122910

Reference 4: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 10
-Section S99
-Paragraph 1
-Subparagraph (SX 210.5-02(13))
-URI http://asc.fasb.org/extlink&oid=120391452&loc=d3e13212-122682

+ Details

Name:	us-gaap_PropertyPlantAndEquipmentNet
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

The cumulative amount of depreciation (related to long-lived, depreciable flight assets owned by the entity and used in the entity's principle business operations and capitalized assets classified as property, plant and equipment that are owned by the entity) that has been recognized in the income statement.

+ References

No definition available.

+ Details

Name:	us-gaap_PropertyPlantAndEquipmentOwnedAccumulatedDepreciation
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Gross amount of long-lived, depreciable flight assets owned by the entity and used in the entity's principle business operations (owned aircraft and capitalized improvements) and capitalized assets classified as property, plant and equipment that are owned by the entity. Excludes assets subject to a capital lease.

+ References

No definition available.

+ Details

Name:	us-gaap_PropertyPlantAndEquipmentOwnedGross
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant