Investment Securities - Investments with Unrealized Loss Positions for Held to maturity (Details) - USD ($) $ in Thousands	Dec. 31, 2020	Jun. 30, 2020
Schedule of Held-to-maturity Securities [Line Items]
Unrealized Holding Losses Less Than 12 Months, Fair Value	$ 10,015	$ 12,731
Unrealized Holding Losses Less Than 12 Months, Unrealized Losses	63	45
Unrealized Holding Losses 12 Months or More, Fair Value	1,886	2,040
Unrealized Holding Losses 12 Months or More, Unrealized Losses	17	17
Unrealized Holding Losses Total, Fair Value	11,901	14,771
Unrealized Holding Losses Total, Unrealized Losses	80	62
U.S. government sponsored enterprise MBS
Schedule of Held-to-maturity Securities [Line Items]
Unrealized Holding Losses Less Than 12 Months, Fair Value	10,015	12,731
Unrealized Holding Losses Less Than 12 Months, Unrealized Losses	63	45
Unrealized Holding Losses 12 Months or More, Fair Value	0	0
Unrealized Holding Losses 12 Months or More, Unrealized Losses	0	0
Unrealized Holding Losses Total, Fair Value	10,015	12,731
Unrealized Holding Losses Total, Unrealized Losses	63	45
U.S. SBA securities
Schedule of Held-to-maturity Securities [Line Items]
Unrealized Holding Losses Less Than 12 Months, Fair Value	0	0
Unrealized Holding Losses Less Than 12 Months, Unrealized Losses	0	0
Unrealized Holding Losses 12 Months or More, Fair Value	1,886	2,040
Unrealized Holding Losses 12 Months or More, Unrealized Losses	17	17
Unrealized Holding Losses Total, Fair Value	1,886	2,040
Unrealized Holding Losses Total, Unrealized Losses	$ 17	$ 17