Impaired Loans (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Mar. 31, 2014	Mar. 31, 2013	Mar. 31, 2012
Financing Receivable, Impaired [Line Items]
Impaired Financing Receivable, Related Allowance	$ 1,631	$ 2,311
Impaired Financing Receivable, Recorded Investment	22,501	31,022
Impaired Financing Receivable, Unpaid Principal Balance	23,327	33,290
Impaired Financing Receivable, Average Recorded Investment	25,805	30,351	42,238
Impaired Financing Receivable, Interest Income, Cash Basis Method	667	825	1,873
One- to four family loans [Member]
Financing Receivable, Impaired [Line Items]
Impaired Financing Receivable, with No Related Allowance, Recorded Investment	639	1,319
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance	893	1,460
Impaired Financing Receivable, with Related Allowance, Recorded Investment	5,833	5,049
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance	5,958	5,244
Impaired Financing Receivable, Related Allowance	520	317
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment	1,541	1,215	1,404
Impaired Financing Receivable, with No Related Allowance, Interest Income, Cash Basis Method	12	47	78
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment	5,290	5,363	4,343
Impaired Financing Receivable, with Related Allowance, Interest Income, Cash Basis Method	142	57	103
Multifamily Loans [Member]
Financing Receivable, Impaired [Line Items]
Impaired Financing Receivable, with No Related Allowance, Recorded Investment	0	616
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance	0	616
Impaired Financing Receivable, with Related Allowance, Recorded Investment	2,240	0
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance	2,240	0
Impaired Financing Receivable, Related Allowance	92	0
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment	729	308	195
Impaired Financing Receivable, with No Related Allowance, Interest Income, Cash Basis Method	17	5	21
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment	513	0	1,391
Impaired Financing Receivable, with Related Allowance, Interest Income, Cash Basis Method	0	0	70
Commercial Real Estate Portfolio Segment [Member]
Financing Receivable, Impaired [Line Items]
Impaired Financing Receivable, with No Related Allowance, Recorded Investment	3,972	11,070
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance	4,147	11,270
Impaired Financing Receivable, with Related Allowance, Recorded Investment	4,812	5,365
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance	5,023	5,913
Impaired Financing Receivable, Related Allowance	255	194
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment	7,941	9,865	7,375
Impaired Financing Receivable, with No Related Allowance, Interest Income, Cash Basis Method	227	235	89
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment	3,991	6,302	15,453
Impaired Financing Receivable, with Related Allowance, Interest Income, Cash Basis Method	43	133	340
Construction Loans [Member]
Financing Receivable, Impaired [Line Items]
Impaired Financing Receivable, with No Related Allowance, Recorded Investment	0	1,230
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance	0	1,492
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment	393	1,230	4,603
Impaired Financing Receivable, with No Related Allowance, Interest Income, Cash Basis Method	0	53	859
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment	0	0	896
Impaired Financing Receivable, with Related Allowance, Interest Income, Cash Basis Method	0	0	0
Commercial Loan [Member]
Financing Receivable, Impaired [Line Items]
Impaired Financing Receivable, with No Related Allowance, Recorded Investment	341	1,080
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance	402	2,002
Impaired Financing Receivable, with Related Allowance, Recorded Investment	4,664	5,293
Impaired Financing Receivable, with Related Allowance, Unpaid Principal Balance	4,664	5,293
Impaired Financing Receivable, Related Allowance	764	1,800
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment	1,508	1,136	5,242
Impaired Financing Receivable, with No Related Allowance, Interest Income, Cash Basis Method	14	41	203
Impaired Financing Receivable, with Related Allowance, Average Recorded Investment	3,899	4,932	1,336
Impaired Financing Receivable, with Related Allowance, Interest Income, Cash Basis Method	212	254	110
Consumer Loan [Member]
Financing Receivable, Impaired [Line Items]
Impaired Financing Receivable, with No Related Allowance, Recorded Investment	0	0
Impaired Financing Receivable, with No Related Allowance, Unpaid Principal Balance	0	0
Impaired Financing Receivable, with No Related Allowance, Average Recorded Investment	0	0	0
Impaired Financing Receivable, with No Related Allowance, Interest Income, Cash Basis Method	$ 0	$ 0	$ 0