Securities - Investments Classified by Contractual Maturity Date (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2014	Jun. 30, 2013
Available for sale debt securities, Amortized Cost [Abstract]
Within one year	$ 5,278
After one year through five years	8,615
After five years through ten years	4,915
After ten years	0
Total available-for-sale debt securities	18,808
Mortgage-backed and asset-backed securities	31,941
Equity securities	62
Available-for-sale Securities, Amortized Cost Basis	50,811	68,926
Held to maturity debt securities, Amortized Cost [Abstract]
Within one year	19,440
After one year through five years	30,528
After five years through ten years	25,655
After ten years	12,776
Total held-to-maturity debt securities	88,399
Mortgage-backed	88,690
Total held-to-maturity securities	177,089	176,519
Total securities, Amortized Cost	227,900	245,445
Available for sale debt securities, Fair Value [Abstract]
Within one year	5,309
After one through five years	9,050
After five through ten years	5,061
After ten years	0
Total available-for-sale debt securities	19,420
Mortgage-backed and asset-backed securities	31,699
Equity securities	161
Estimated Fair Value	51,280	69,644
Held to maturity debt securities, Fair Value [Abstract]
Within one year	19,464
After one year through five years	30,874
After five years through ten years	25,545
After ten years	12,589
Total held-to-maturity debt securities	88,472
Mortgage-backed securities	87,831
Estimated Fair Value	176,303	177,660
Total securities	227,583
Equity securities [Member]
Available for sale debt securities, Amortized Cost [Abstract]
Available-for-sale Securities, Amortized Cost Basis	62	68
Available for sale debt securities, Fair Value [Abstract]
Estimated Fair Value	$ 161	$ 153