Securities, Securities by Contractual Maturity (Details) - USD ($) $ in Thousands	Mar. 31, 2017	Jun. 30, 2016
Available-for-sale Debt Securities, Amortized Cost [Abstract]
Within one year	$ 47,747
After one year through five years	5,627
After five years through ten years	0
After ten years	0
Total available for sale debt securities	53,374
Mortgage-backed and asset-backed securities	22,905
Equity securities	62	$ 62
Amortized cost	76,341	98,127
Available-for-sale Debt Securities, Fair Value [Abstract]
Within one year	47,838
After one through five years	5,797
After five through ten years	0
After ten years	0
Total available-for-sale debt securities	53,635
Mortgage-backed and asset-backed securities	23,228
Equity securities	178	152
Estimated fair value	77,041	100,123
Held-to-maturity Debt Securities, Amortized Cost [Abstract]
Within one year	16,068
After one year through five years	57,964
After five years through ten years	33,791
After ten years	12,108
Total held-to-maturity debt securities	119,931
Mortgage-backed	94,369
Amortized cost	214,300	204,935
Held-to-maturity Debt Securities, Fair Value [Abstract]
Within one year	16,236
After one year through five years	59,043
After five years through ten years	34,574
After ten years	12,647
Total held-to-maturity debt securities	122,500
Mortgage-backed	94,893
Estimated fair value	217,393	214,058
Total Securities [Abstract]
Amortized cost	290,641	303,062
Estimated fair value	294,434	314,181
Securities pledged as collateral for deposits in excess of FDIC insurance limits, fair value	277,800	291,600
Securities pledged as collateral for potential borrowings at the Federal Reserve Bank discount window	$ 2,800	$ 4,200