Securities - Unrealized Gain (Loss) on Investments (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Jun. 30, 2013
Securities available for sale [Abstract]
Available-for-sale Securities, Amortized Cost Basis	$ 55,473	$ 68,926
Gross Unrealized Gains	1,048	1,236
Gross Unrealized Losses	370	518
Securities available for sale, at fair value	56,151	69,644
Securities held to maturity [Abstract]
Total held-to-maturity securities	181,946	176,519
Gross Unrealized Gains	2,697	3,146
Gross Unrealized Losses	2,711	2,005
Estimated Fair Value	181,932	177,660
Total securities [Abstract]
Total Securities, Amortized Cost	237,419	245,445
Total Securities, Gross Unrealized Gains	3,745	4,382
Total Securities, Gross Unrealized Losses	3,081	2,523
Total Securities, Estimated Fair Value	238,083	247,304
US Treasury securities [Member]
Securities held to maturity [Abstract]
Total held-to-maturity securities		5,500
Gross Unrealized Gains		17
Gross Unrealized Losses		0
Estimated Fair Value		5,517
U.S. Government sponsored enterprises [Member]
Securities available for sale [Abstract]
Available-for-sale Securities, Amortized Cost Basis	10,648	12,729
Gross Unrealized Gains	250	260
Gross Unrealized Losses	0	0
Securities available for sale, at fair value	10,898	12,989
Securities held to maturity [Abstract]
Total held-to-maturity securities	2,000	2,999
Gross Unrealized Gains	0	16
Gross Unrealized Losses	102	113
Estimated Fair Value	1,898	2,902
State and political subdivisions [Member]
Securities available for sale [Abstract]
Available-for-sale Securities, Amortized Cost Basis	1,324	1,849
Gross Unrealized Gains	23	29
Gross Unrealized Losses	0	20
Securities available for sale, at fair value	1,347	1,858
Securities held to maturity [Abstract]
Total held-to-maturity securities	91,634	82,801
Gross Unrealized Gains	787	362
Gross Unrealized Losses	204	755
Estimated Fair Value	92,217	82,408
Mortgage-backed securities-residential [Member]
Securities available for sale [Abstract]
Available-for-sale Securities, Amortized Cost Basis	9,345	7,340
Gross Unrealized Gains	213	193
Gross Unrealized Losses	13	0
Securities available for sale, at fair value	9,545	7,533
Securities held to maturity [Abstract]
Total held-to-maturity securities	22,785	29,077
Gross Unrealized Gains	1,150	1,515
Gross Unrealized Losses	0	9
Estimated Fair Value	23,935	30,583
Mortgage-backed securities-multi-family [Member]
Securities available for sale [Abstract]
Available-for-sale Securities, Amortized Cost Basis	29,268	42,096
Gross Unrealized Gains	89	289
Gross Unrealized Losses	339	466
Securities available for sale, at fair value	29,018	41,919
Securities held to maturity [Abstract]
Total held-to-maturity securities	64,605	55,086
Gross Unrealized Gains	759	1,236
Gross Unrealized Losses	2,381	1,093
Estimated Fair Value	62,983	55,229
Other securities [Member]
Securities held to maturity [Abstract]
Total held-to-maturity securities	922	1,056
Gross Unrealized Gains	1	0
Gross Unrealized Losses	24	35
Estimated Fair Value	899	1,021
Asset-backed securities [Member]
Securities available for sale [Abstract]
Available-for-sale Securities, Amortized Cost Basis	15	17
Gross Unrealized Gains	0	0
Gross Unrealized Losses	2	1
Securities available for sale, at fair value	13	16
Corporate debt securities [Member]
Securities available for sale [Abstract]
Available-for-sale Securities, Amortized Cost Basis	4,811	4,827
Gross Unrealized Gains	375	380
Gross Unrealized Losses	16	31
Securities available for sale, at fair value	5,170	5,176
Debt securities [Member]
Securities available for sale [Abstract]
Available-for-sale Securities, Amortized Cost Basis	55,411	68,858
Gross Unrealized Gains	950	1,151
Gross Unrealized Losses	370	518
Securities available for sale, at fair value	55,991	69,491
Equity securities [Member]
Securities available for sale [Abstract]
Available-for-sale Securities, Amortized Cost Basis	62	68
Gross Unrealized Gains	98	85
Gross Unrealized Losses	0	0
Securities available for sale, at fair value	$ 160	$ 153