Investment Securities (Details 3) - USD ($) $ in Thousands	Jun. 30, 2019	Jun. 30, 2018
Schedule of Held-to-maturity Securities [Line Items]
Unrealized Holding Losses Less Than 12 Months, Fair Value	$ 6,507	$ 50,009
Unrealized Holding Losses Less Than 12 Months, Unrealized Losses	8	777
Unrealized Holding Losses 12 Months or More, Fair Value	4,540	0
Unrealized Holding Losses 12 Months or More, Unrealized Losses	12	0
Unrealized Holding Losses Total, Fair Value	11,047	50,009
Unrealized Holding Losses Total, Unrealized Losses	20	777
U.S. government sponsored enterprise MBS
Schedule of Held-to-maturity Securities [Line Items]
Unrealized Holding Losses Less Than 12 Months, Fair Value	6,507	47,045
Unrealized Holding Losses Less Than 12 Months, Unrealized Losses	8	762
Unrealized Holding Losses 12 Months or More, Fair Value	1,657	0
Unrealized Holding Losses 12 Months or More, Unrealized Losses	6	0
Unrealized Holding Losses Total, Fair Value	8,164	47,045
Unrealized Holding Losses Total, Unrealized Losses	14	762
U.S. SBA securities
Schedule of Held-to-maturity Securities [Line Items]
Unrealized Holding Losses Less Than 12 Months, Fair Value	0	2,964
Unrealized Holding Losses Less Than 12 Months, Unrealized Losses	0	15
Unrealized Holding Losses 12 Months or More, Fair Value	2,883	0
Unrealized Holding Losses 12 Months or More, Unrealized Losses	6	0
Unrealized Holding Losses Total, Fair Value	2,883	2,964
Unrealized Holding Losses Total, Unrealized Losses	$ 6	$ 15