Securities, Securities by Contractual Maturity (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Jun. 30, 2016
Available-for-sale Debt Securities, Amortized Cost [Abstract]
Within one year	$ 60,387
After one year through five years	4,829
After five years through ten years	0
After ten years	0
Total available-for-sale debt securities	65,216
Mortgage-backed and asset-backed securities	25,213
Equity securities	62	$ 62
Amortized cost	90,491	98,127
Available-for-sale Debt Securities, Fair Value [Abstract]
Within one year	60,641
After one year through five years	4,979
After five years through ten years	0
After ten years	0
Total available-for-sale debt securities	65,620
Mortgage-backed and asset-backed securities	25,679
Equity securities	184	152
Estimated fair value	91,483	100,123
Held-to-maturity Debt Securities, Amortized Cost [Abstract]
Within one year	17,403
After one year through five years	56,441
After five years through ten years	38,309
After ten years	12,177
Total held-to-maturity debt securities	124,330
Mortgage-backed	99,500
Amortized cost	223,830	204,935
Held-to-maturity Debt Securities, Fair Value [Abstract]
Within one year	17,642
After one year through five years	57,713
After five years through ten years	39,415
After ten years	12,850
Total held-to-maturity debt securities	127,620
Mortgage-backed securities	100,832
Estimated fair value	228,452	214,058
Total Securities [Abstract]
Amortized cost	314,321	303,062
Estimated fair value	319,935	314,181
Securities pledged as collateral for deposits in excess of FDIC insurance limits, fair value	305,700	291,600
Securities pledged as collateral for potential borrowings at the Federal Reserve Bank discount window	$ 2,800	$ 4,200