Securities, Securities by Contractual Maturity (Details) - USD ($) $ in Thousands	Mar. 31, 2016	Jun. 30, 2015
Available-for-sale Debt Securities, Amortized Cost [Abstract]
Within one year	$ 63,694
After one year through five years	8,169
After five years through ten years	0
After ten years	0
Total available for sale debt securities	71,863
Mortgage-backed and asset-backed securities	29,676
Equity securities	62	$ 62
Amortized cost	101,601	84,886
Available-for-sale Debt Securities, Fair Value [Abstract]
Within one year	63,723
After one through five years	8,589
After five through ten years	0
After ten years	0
Total available-for-sale debt securities	72,312
Mortgage-backed and asset-backed securities	30,779
Equity securities	155	137
Estimated fair value	103,246	86,034
Held-to-maturity Debt Securities, Amortized Cost [Abstract]
Within one year	14,012
After one year through five years	52,959
After five years through ten years	25,455
After ten years	10,491
Total held-to-maturity debt securities	102,917
Mortgage-backed	88,659
Amortized cost	191,576	169,000
Held-to-maturity Debt Securities, Fair Value [Abstract]
Within one year	14,201
After one year through five years	54,390
After five years through ten years	26,601
After ten years	11,156
Total held-to-maturity debt securities	106,348
Mortgage-backed	91,304
Estimated fair value	197,652	171,976
Total Securities [Abstract]
Amortized cost	293,177	253,886
Estimated fair value	300,898	258,010
Securities pledged as collateral for deposits in excess of FDIC insurance limits, fair value	277,400	223,100
Securities pledged as collateral for potential borrowings at the Federal Reserve Bank discount window	$ 4,200	$ 4,800