Securities, Securities by Contractual Maturity (Details) - USD ($) $ in Thousands	Jun. 30, 2016	Jun. 30, 2015
Available-for-sale Debt Securities, Amortized Cost [Abstract]
Within one year	$ 60,946
After one year through five years	8,160
After five years through ten years	0
After ten years	0
Total available-for-sale debt securities	69,106
Mortgage-backed and asset-backed securities	28,959
Equity securities	62	$ 62
Amortized cost	98,127	84,886
Available-for-sale Debt Securities, Fair Value [Abstract]
Within one year	60,960
After one year through five years	8,587
After five years through ten years	0
After ten years	0
Total available-for-sale debt securities	69,547
Mortgage-backed and asset-backed securities	30,424
Equity securities	152	137
Estimated fair value	100,123	86,034
Held-to-maturity Debt Securities, Amortized Cost [Abstract]
Within one year	14,049
After one year through five years	52,196
After five years through ten years	26,629
After ten years	11,314
Total held-to-maturity debt securities	104,188
Mortgage-backed	100,747
Amortized cost	204,935	169,000
Held-to-maturity Debt Securities, Fair Value [Abstract]
Within one year	14,336
After one year through five years	54,076
After five years through ten years	28,324
After ten years	12,502
Total held-to-maturity debt securities	109,238
Mortgage-backed securities	104,820
Estimated fair value	214,058	171,976
Total Securities [Abstract]
Amortized cost	303,062	253,886
Estimated fair value	314,181	258,010
Securities pledged as collateral for deposits in excess of FDIC insurance limits, fair value	291,600	223,100
Securities pledged as collateral for potential borrowings at the Federal Reserve Bank discount window	$ 4,200	$ 4,800