Fair Value of Financial Instruments (Details 3) - USD ($) $ in Thousands	Jun. 30, 2019	Jun. 30, 2018	Jun. 30, 2017
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage servicing assets	$ 627	$ 1,015	$ 811
Nonrecurring
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Non-performing loans	6,218	6,057
Mortgage servicing assets	627	135
Real estate owned, net	0	906
Total	6,845	7,098
Nonrecurring | Level 1
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Non-performing loans	0	0
Mortgage servicing assets	0	0
Real estate owned, net	0	0
Total	0	0
Nonrecurring | Level 2
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Non-performing loans	3,971	4,845
Mortgage servicing assets	0	0
Real estate owned, net	0	906
Total	3,971	5,751
Nonrecurring | Level 3
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Non-performing loans	2,247	1,212
Mortgage servicing assets	627	135
Real estate owned, net	0	0
Total	$ 2,874	$ 1,347