Reportable Segments (Schedules) (Details) - USD ($) $ in Thousands		12 Months Ended
		Jun. 30, 2019	Jun. 30, 2018
Net interest income		$ 38,170	$ 36,300
Provision (recovery) for loan losses		(475)	(536)
Net interest income, after provision (recovery) for loan losses		38,645	36,836
Non-interest income:
Gain on sale of loans, net	[1]	7,135	15,802
Loss on sale and operations of real estate owned acquired in the settlement of loans, net		(4)	(86)
Other		833	944
Total non-interest income		12,511	21,895
Non-interest expense:
Salaries and employee benefits	[2]	30,149	34,821
Premises and occupancy	[3]	5,038	5,134
Operating and administrative expenses	[4]	10,049	13,249
Total non-interest expense		45,236	53,204
Income (loss) before taxes		5,920	5,527
Provision (benefit) for income taxes	[5]	1,503	3,396
Net income (loss)		4,417	2,131
Total assets, end of period		1,084,850	1,175,549
Loan servicing and other fees
Non-interest income:
Total non-interest income	[1]	1,051	1,575
Deposit account fees
Non-interest income:
Total non-interest income		1,928	2,119
Card and processing fees
Non-interest income:
Total non-interest income		$ 1,568	$ 1,541

[1] Not in scope of ASC 606.

[2] Includes $1.7 million of non-recurring expenses related to scaling back of the origination of saleable single-family mortgage loans for the fiscal year ended June 30, 2019.

[3] Includes $0.3 million of non-recurring expenses related to scaling back of the origination of saleable single-family mortgage loans for the fiscal year ended June 30, 2019.

[4] Includes $0.8 million of non-recurring expenses related to scaling back of the origination of saleable single-family mortgage loans for the fiscal year ended June 30, 2019.

[5] Includes a net tax charge of $1.8 million resulting from the revaluation of net deferred tax assets consistent with the Tax Cuts and Jobs Act of 2017 ("Tax Act") for the fiscal year ended June 30, 2018.