Premises and Equipment - Summary of Premises and Equipment (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Jun. 30, 2013
Property, Plant and Equipment [Line Items]
Less: accumulated depreciation	$ (7,559)	$ (10,163)
Total premises and equipment	14,307	14,349
Land [Member]
Property, Plant and Equipment [Line Items]
Property, plant and equipment, gross	2,883	2,883
Building and improvements [Member]
Property, Plant and Equipment [Line Items]
Property, plant and equipment, gross	15,411	14,888
Furniture and equipment [Member]
Property, Plant and Equipment [Line Items]
Property, plant and equipment, gross	$ 3,572	$ 6,741