LOANS HELD FOR INVESTMENT, Allowance for Credit Losses by Portfolio Type (Details) - USD ($)	3 Months Ended		6 Months Ended
	Jun. 30, 2021	Jun. 30, 2020	Jun. 30, 2021	Jun. 30, 2020	Dec. 31, 2020
Summary of allowance for loan losses [Roll Forward]
Beginning balance	$ 10,233,000	$ 9,167,000	$ 10,194,000	$ 8,717,000
Charge-offs	0	0	0	0
Recoveries	48,000	79,000	260,000	137,000
Net recoveries	48,000	79,000	260,000	137,000
Provision (credit)	(41,000)	762,000	(214,000)	1,154,000
Ending balance	10,240,000	10,008,000	10,240,000	10,008,000
Reserve for credit losses on undisbursed loans	78,000		78,000		$ 92,000
Manufactured Housing [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	2,623,000	2,364,000	2,612,000	2,184,000
Charge-offs	0	0	0	0
Recoveries	12,000	7,000	151,000	13,000
Net recoveries	12,000	7,000	151,000	13,000
Provision (credit)	(5,000)	99,000	(133,000)	273,000
Ending balance	2,630,000	2,470,000	2,630,000	2,470,000
Commercial Real Estate [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	6,220,000	5,484,000	5,950,000	5,217,000
Charge-offs	0	0	0	0
Recoveries	20,000	20,000	40,000	40,000
Net recoveries	20,000	20,000	40,000	40,000
Provision (credit)	88,000	255,000	338,000	502,000
Ending balance	6,328,000	5,759,000	6,328,000	5,759,000
Commercial [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	1,108,000	1,164,000	1,379,000	1,162,000
Charge-offs	0	0	0	0
Recoveries	10,000	47,000	20,000	74,000
Net recoveries	10,000	47,000	20,000	74,000
Provision (credit)	(98,000)	292,000	(379,000)	267,000
Ending balance	1,020,000	1,503,000	1,020,000	1,503,000
SBA [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	130,000	29,000	118,000	32,000
Charge-offs	0	0	0	0
Recoveries	4,000	3,000	45,000	6,000
Net recoveries	4,000	3,000	45,000	6,000
Provision (credit)	(20,000)	96,000	(49,000)	90,000
Ending balance	114,000	128,000	114,000	128,000
HELOC [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	25,000	27,000	25,000	27,000
Charge-offs	0	0	0	0
Recoveries	1,000	2,000	3,000	3,000
Net recoveries	1,000	2,000	3,000	3,000
Provision (credit)	(1,000)	(3,000)	(3,000)	(4,000)
Ending balance	25,000	26,000	25,000	26,000
Single Family Real Estate [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	126,000	96,000	108,000	92,000
Charge-offs	0	0	0	0
Recoveries	1,000	0	1,000	1,000
Net recoveries	1,000	0	1,000	1,000
Provision (credit)	(5,000)	24,000	13,000	27,000
Ending balance	122,000	120,000	122,000	120,000
Consumer [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	1,000	3,000	2,000	3,000
Charge-offs	0	0	0	0
Recoveries	0	0	0	0
Net recoveries	0	0	0	0
Provision (credit)	0	(1,000)	(1,000)	(1,000)
Ending balance	$ 1,000	$ 2,000	$ 1,000	$ 2,000