LOANS - Loans Receivable (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Mar. 31, 2020	Dec. 31, 2019	Jun. 30, 2019	Mar. 31, 2019	Dec. 31, 2018
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans held for investment, gross	$ 6,281,039		$ 6,230,977
Allowance for loan losses	(45,985)	$ (40,657)	(36,001)	$ (35,221)	$ (34,692)	$ (34,314)
Loans held for investment, net	6,235,054		6,194,976
Multifamily residential
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans held for investment, gross	4,082,224		3,985,981
Allowance for loan losses	(30,837)	(27,308)	(23,372)	(22,745)	(22,046)	(21,326)
Multifamily residential | Permanent mortgages
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans held for investment, gross	4,082,224		3,985,981
Single family residential
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans held for investment, gross	1,969,563		2,021,320
Allowance for loan losses	(11,628)	(10,426)	(10,076)	(9,439)	(9,889)	(10,125)
Single family residential | Permanent mortgages
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans held for investment, gross	1,969,563		2,021,320
Commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans held for investment, gross	211,135		203,134
Allowance for loan losses	(3,305)	(2,677)	(2,341)	(2,412)	(2,278)	(2,441)
Commercial real estate | Permanent mortgages
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans held for investment, gross	211,135		203,134
Construction and land loans | Permanent mortgages
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans held for investment, gross	18,017		20,442
Land, Construction and NM
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans held for investment, gross	18,117		20,542
Allowance for loan losses	(215)	$ (246)	(212)	$ (625)	$ (479)	$ (422)
Land, Construction and NM | Non-Mortgage loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loans held for investment, gross	$ 100		$ 100