Fair Value of Financial Instruments - Schedule of Fair Value, by Balance Sheet Grouping (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Jun. 30, 2020
Fair Value, Inputs, Level 1 | Cash and interest-bearing deposits
Financial Instruments Owned	$ 171,144	$ 121,622
Fair Value, Inputs, Level 1 | Commercial paper
Financial Instruments Owned	204,867	304,967
Fair Value, Inputs, Level 1 | Certificates of deposit in other banks
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Securities available for sale
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Loans, net
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Loans held for sale
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | FHLB Stock
Financial Instruments Owned	23,309	23,309
Fair Value, Inputs, Level 1 | FRB Stock
Financial Instruments Owned	7,371	7,368
Fair Value, Inputs, Level 1 | Small Business Investment Company Funds
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Accrued interest receivable
Financial Instruments Owned	0	208
Fair Value, Inputs, Level 1 | Noninterest-bearing and NOW deposits
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Money market accounts
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Savings accounts
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Certificates of deposit
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Other borrowings
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 1 | Accrued interest payable
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Cash and interest-bearing deposits
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Commercial paper
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Certificates of deposit in other banks
Financial Instruments Owned	52,361	55,689
Fair Value, Inputs, Level 2 | Securities available for sale
Financial Instruments Owned	96,159	127,537
Fair Value, Inputs, Level 2 | Loans, net
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Loans held for sale
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | FHLB Stock
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | FRB Stock
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Small Business Investment Company Funds
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 2 | Accrued interest receivable
Financial Instruments Owned	789	744
Fair Value, Inputs, Level 2 | Noninterest-bearing and NOW deposits
Financial Instruments Owned	1,067,125	1,012,200
Fair Value, Inputs, Level 2 | Money market accounts
Financial Instruments Owned	826,970	836,738
Fair Value, Inputs, Level 2 | Savings accounts
Financial Instruments Owned	202,787	197,676
Fair Value, Inputs, Level 2 | Certificates of deposit
Financial Instruments Owned	649,685	745,078
Fair Value, Inputs, Level 2 | Other borrowings
Financial Instruments Owned	490,822	511,529
Fair Value, Inputs, Level 2 | Accrued interest payable
Financial Instruments Owned	719	1,087
Fair Value, Inputs, Level 3 | Cash and interest-bearing deposits
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Commercial paper
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Certificates of deposit in other banks
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Securities available for sale
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Loans, net
Financial Instruments Owned	2,688,377	2,692,265
Fair Value, Inputs, Level 3 | Loans held for sale
Financial Instruments Owned	126,670	78,129
Fair Value, Inputs, Level 3 | FHLB Stock
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | FRB Stock
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Small Business Investment Company Funds
Financial Instruments Owned	8,269	8,269
Fair Value, Inputs, Level 3 | Accrued interest receivable
Financial Instruments Owned	9,859	11,360
Fair Value, Inputs, Level 3 | Noninterest-bearing and NOW deposits
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Money market accounts
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Savings accounts
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Certificates of deposit
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Other borrowings
Financial Instruments Owned	0	0
Fair Value, Inputs, Level 3 | Accrued interest payable
Financial Instruments Owned	0	0
Carrying Value | Cash and interest-bearing deposits
Financial Instruments Owned	171,144	121,622
Carrying Value | Commercial paper
Financial Instruments Owned	204,867	304,967
Carrying Value | Certificates of deposit in other banks
Financial Instruments Owned	52,361	55,689
Carrying Value | Securities available for sale
Financial Instruments Owned	96,159	127,537
Carrying Value | Loans, net
Financial Instruments Owned	2,726,264	2,741,047
Carrying Value | Loans held for sale
Financial Instruments Owned	124,985	77,177
Carrying Value | FHLB Stock
Financial Instruments Owned	23,309	23,309
Carrying Value | FRB Stock
Financial Instruments Owned	7,371	7,368
Carrying Value | Small Business Investment Company Funds
Financial Instruments Owned	8,269	8,269
Carrying Value | Accrued interest receivable
Financial Instruments Owned	10,648	12,312
Carrying Value | Noninterest-bearing and NOW deposits
Financial Instruments Owned	1,067,125	1,012,200
Carrying Value | Money market accounts
Financial Instruments Owned	826,970	836,738
Carrying Value | Savings accounts
Financial Instruments Owned	202,787	197,676
Carrying Value | Certificates of deposit
Financial Instruments Owned	645,164	739,142
Carrying Value | Other borrowings
Financial Instruments Owned	475,000	475,000
Carrying Value | Accrued interest payable
Financial Instruments Owned	719	1,087
Fair Value | Cash and interest-bearing deposits
Financial Instruments Owned	171,144	121,622
Fair Value | Commercial paper
Financial Instruments Owned	204,867	304,967
Fair Value | Certificates of deposit in other banks
Financial Instruments Owned	52,361	55,689
Fair Value | Securities available for sale
Financial Instruments Owned	96,159	127,537
Fair Value | Loans, net
Financial Instruments Owned	2,688,377	2,692,265
Fair Value | Loans held for sale
Financial Instruments Owned	126,670	78,129
Fair Value | FHLB Stock
Financial Instruments Owned	23,309	23,309
Fair Value | FRB Stock
Financial Instruments Owned	7,371	7,368
Fair Value | Small Business Investment Company Funds
Financial Instruments Owned	8,269	8,269
Fair Value | Accrued interest receivable
Financial Instruments Owned	10,648	12,312
Fair Value | Noninterest-bearing and NOW deposits
Financial Instruments Owned	1,067,125	1,012,200
Fair Value | Money market accounts
Financial Instruments Owned	826,970	836,738
Fair Value | Savings accounts
Financial Instruments Owned	202,787	197,676
Fair Value | Certificates of deposit
Financial Instruments Owned	649,685	745,078
Fair Value | Other borrowings
Financial Instruments Owned	490,822	511,529
Fair Value | Accrued interest payable
Financial Instruments Owned	$ 719	$ 1,087