GOODWILL AND INTANGIBLE ASSETS - Carrying Value of Goodwill (Details) - USD ($)	12 Months Ended
	Dec. 31, 2023	Dec. 31, 2022
Goodwill [Roll Forward]
Beginning balance	$ 85,199,000	$ 85,199,000
Goodwill acquired	46,658,000	0
Accumulated impairment loss	0	0
Ending balance	131,857,000	85,199,000
Origination and servicing
Goodwill [Roll Forward]
Beginning balance	24,376,000	24,376,000
Goodwill acquired	0	0
Accumulated impairment loss	0	0
Ending balance	24,376,000	24,376,000
Investment Portfolio
Goodwill [Roll Forward]
Beginning balance	5,092,000	5,092,000
Goodwill acquired	0	0
Accumulated impairment loss	0	0
Ending balance	5,092,000	5,092,000
Mortgage Loans Receivable
Goodwill [Roll Forward]
Beginning balance	55,731,000	55,731,000
Goodwill acquired	0	0
Accumulated impairment loss	0	0
Ending balance	55,731,000	55,731,000
Asset Management
Goodwill [Roll Forward]
Beginning balance	0	0
Goodwill acquired	46,658,000	0
Accumulated impairment loss	0	0
Ending balance	$ 46,658,000	$ 0