Federal and State Income Taxes - Income Tax Contingency (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Jun. 30, 2014	Jun. 30, 2013	Jun. 30, 2012
Reconciliation of Unrecognized Tax Benefits, Excluding Amounts Pertaining to Examined Tax Returns [Roll Forward]
Unrecognized tax benefits, beginning of year	$ 1,131	$ 740	$ 10,822
Decreases for tax positions related to prior years	(130)	0	(9,566)
Increases for tax positions taken during the year	431	391	68
Unrecognized tax benefits, end of year	1,432	1,131	740
Unrecognized Tax Benefits that Would Impact Effective Tax Rate	408	421
Unrecognized Tax Benefits, Income Tax Penalties and Interest Expense	24	16
Unrecognized Tax Benefits, Income Tax Penalties and Interest Accrued	108	83
Reduction due to statute of limitation expirations	$ 0	$ 0	$ (584)