LOANS HELD FOR INVESTMENT, Allowance for Credit Losses by Portfolio Type (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2017	Sep. 30, 2016	Sep. 30, 2017	Sep. 30, 2016	Dec. 31, 2016
Summary of allowance for loan losses [Roll Forward]
Beginning balance	$ 7,994	$ 7,028	$ 7,464	$ 6,916
Charge-offs	(33)	(100)	(203)	(162)
Recoveries	192	240	628	600
Net (charge-offs) recoveries	159	140	425	438
Provision (credit)	159	22	423	(164)
Ending balance	8,312	7,190	8,312	7,190
Reserve for credit losses on undisbursed loans	96		96		$ 125
Manufactured Housing [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	2,124	2,188	2,201	3,525
Charge-offs	0	0	(119)	(41)
Recoveries	38	121	105	126
Net (charge-offs) recoveries	38	121	(14)	85
Provision (credit)	(15)	(102)	(40)	(1,403)
Ending balance	2,147	2,207	2,147	2,207
Commercial Real Estate [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	4,332	3,078	3,707	1,853
Charge-offs	0	0	0	0
Recoveries	0	0	227	13
Net (charge-offs) recoveries	0	0	227	13
Provision (credit)	359	194	757	1,406
Ending balance	4,691	3,272	4,691	3,272
Commercial [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	1,262	1,251	1,241	939
Charge-offs	0	0	0	0
Recoveries	43	40	116	120
Net (charge-offs) recoveries	43	40	116	120
Provision (credit)	(100)	66	(152)	298
Ending balance	1,205	1,357	1,205	1,357
SBA [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	91	322	106	451
Charge-offs	0	(100)	(30)	(121)
Recoveries	104	12	168	196
Net (charge-offs) recoveries	104	(88)	138	75
Provision (credit)	(108)	(142)	(157)	(434)
Ending balance	87	92	87	92
HELOC [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	98	62	100	43
Charge-offs	0	0	0	0
Recoveries	7	66	11	74
Net (charge-offs) recoveries	7	66	11	74
Provision (credit)	(11)	(25)	(17)	(14)
Ending balance	94	103	94	103
Single Family Real Estate [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	87	126	109	103
Charge-offs	(33)	0	(54)	0
Recoveries	0	1	1	71
Net (charge-offs) recoveries	(33)	1	(53)	71
Provision (credit)	34	31	32	(16)
Ending balance	88	158	88	158
Consumer [Member]
Summary of allowance for loan losses [Roll Forward]
Beginning balance	0	1	0	2
Charge-offs	0	0	0	0
Recoveries	0	0	0	0
Net (charge-offs) recoveries	0	0	0	0
Provision (credit)	0	0	0	(1)
Ending balance	$ 0	$ 1	$ 0	$ 1