LOANS HELD FOR INVESTMENT, Allowance for Credit Losses by Portfolio Type (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2016	Sep. 30, 2015	Sep. 30, 2016	Sep. 30, 2015	Dec. 31, 2015
Summary of provision, charge-offs and recoveries by loan category [Roll Forward]
Beginning balance	$ 7,028	$ 7,243	$ 6,916	$ 7,877
Charge-offs	(100)	(33)	(162)	(258)
Recoveries	240	247	600	1,390
Net (charge-offs) recoveries	140	214	438	1,132
Provision (credit)	22	(445)	(164)	(1,997)
Ending balance	7,190	7,012	7,190	7,012
Reserve for credit losses on undisbursed loans	83		83		$ 61
Manufactured Housing [Member]
Summary of provision, charge-offs and recoveries by loan category [Roll Forward]
Beginning balance	2,188	3,808	3,525	4,032
Charge-offs	0	(33)	(41)	(258)
Recoveries	121	38	126	103
Net (charge-offs) recoveries	121	5	85	(155)
Provision (credit)	(102)	(220)	(1,403)	(284)
Ending balance	2,207	3,593	2,207	3,593
Commercial Real Estate [Member]
Summary of provision, charge-offs and recoveries by loan category [Roll Forward]
Beginning balance	3,078	1,779	1,853	1,459
Charge-offs	0	0	0	0
Recoveries	0	13	13	533
Net (charge-offs) recoveries	0	13	13	533
Provision (credit)	194	43	1,406	(157)
Ending balance	3,272	1,835	3,272	1,835
Commercial [Member]
Summary of provision, charge-offs and recoveries by loan category [Roll Forward]
Beginning balance	1,251	795	939	986
Charge-offs	0	0	0	0
Recoveries	40	40	120	383
Net (charge-offs) recoveries	40	40	120	383
Provision (credit)	66	35	298	(499)
Ending balance	1,357	870	1,357	870
SBA [Member]
Summary of provision, charge-offs and recoveries by loan category [Roll Forward]
Beginning balance	322	686	451	1,066
Charge-offs	(100)	0	(121)	0
Recoveries	12	153	196	361
Net (charge-offs) recoveries	(88)	153	75	361
Provision (credit)	(142)	(284)	(434)	(872)
Ending balance	92	555	92	555
HELOC [Member]
Summary of provision, charge-offs and recoveries by loan category [Roll Forward]
Beginning balance	62	45	43	140
Charge-offs	0	0	0	0
Recoveries	66	3	74	8
Net (charge-offs) recoveries	66	3	74	8
Provision (credit)	(25)	(5)	(14)	(105)
Ending balance	103	43	103	43
Single Family Real Estate [Member]
Summary of provision, charge-offs and recoveries by loan category [Roll Forward]
Beginning balance	126	129	103	192
Charge-offs	0	0	0	0
Recoveries	1	0	71	2
Net (charge-offs) recoveries	1	0	71	2
Provision (credit)	31	(15)	(16)	(80)
Ending balance	158	114	158	114
Consumer [Member]
Summary of provision, charge-offs and recoveries by loan category [Roll Forward]
Beginning balance	1	1	2	2
Charge-offs	0	0	0	0
Recoveries	0	0	0	0
Net (charge-offs) recoveries	0	0	0	0
Provision (credit)	0	1	(1)	0
Ending balance	$ 1	$ 2	$ 1	$ 2