Securities - Investments Classified by Contractual Maturity Date (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Jun. 30, 2013
Available for sale debt securities, Amortized Cost [Abstract]
Within one year	$ 3,265
After one year through five years	8,891
After five years through ten years	4,627
After ten years	0
Total available-for-sale debt securities	16,783
Mortgage-backed and asset-backed securities	38,628
Equity securities	62
Available-for-sale Securities, Amortized Cost Basis	55,473	68,926
Held to maturity debt securities, Amortized Cost [Abstract]
Within one year	29,835
After one year through five years	38,047
After five years through ten years	19,286
After ten years	7,388
Total held-to-maturity debt securities	94,556
Mortgage-backed	87,390
Total held-to-maturity securities	181,946	176,519
Total securities, Amortized Cost	237,419	245,445
Available for sale debt securities, Fair Value [Abstract]
Within one year	3,280
After one through five years	9,312
After five through ten years	4,823
After ten years	0
Total available-for-sale debt securities	17,415
Mortgage-backed and asset-backed securities	38,576
Equity securities	160
Estimated Fair Value	56,151	69,644
Held to maturity debt securities, Fair Value [Abstract]
Within one year	29,879
After one year through five years	38,564
After five years through ten years	19,254
After ten years	7,317
Total held-to-maturity debt securities	95,014
Mortgage-backed securities	86,918
Estimated Fair Value	181,932	177,660
Total securities	238,083
Equity securities [Member]
Available for sale debt securities, Amortized Cost [Abstract]
Available-for-sale Securities, Amortized Cost Basis	62	68
Available for sale debt securities, Fair Value [Abstract]
Estimated Fair Value	$ 160	$ 153