SEGMENT REPORTING - Reportable Segments and Reconciliation (Details) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2020 USD ($)	Sep. 30, 2020 USD ($)	Jun. 30, 2020 USD ($)	Mar. 31, 2020 USD ($)	Dec. 31, 2019 USD ($)	Sep. 30, 2019 USD ($)	Jun. 30, 2019 USD ($)	Mar. 31, 2019 USD ($)	Dec. 31, 2020 USD ($) segment	Dec. 31, 2019 USD ($)	Dec. 31, 2018 USD ($)	Dec. 31, 2017 USD ($)
Information About the Reportable Segments
Number of Reportable Segments | segment									3
Interest income	$ 19,353	$ 18,627	$ 21,774	$ 20,699	$ 21,230	$ 21,038	$ 20,470	$ 19,623	$ 80,453	$ 82,361	$ 69,760
Interest expense									11,627	22,961	17,706
NET INTEREST INCOME	17,687	16,510	18,458	16,171	15,865	15,034	14,529	13,972	68,826	59,400	52,054
Provision for loan losses									16,579	1,789	2,440
Net interest income after provision for loan losses									52,247	57,611	49,614
Noninterest Income:
Mortgage fee income									33,427	41,045	32,337
Other income									58,410	23,559	6,303
Total noninterest income									91,837	64,604	38,640
Noninterest Expenses:
Salaries and employee benefits									61,629	56,175	46,224
Other expenses									35,512	31,026	26,654
Total noninterest expense									97,141	87,201	72,878
Income (loss) before income taxes									46,943	35,014	15,376
Income tax expense (benefit)									9,532	8,450	3,373
Net income (loss) from continuing operations									37,411	26,564	12,003
Income from discontinued operations, before income taxes									0	575	0
Income tax expense - discontinued operations									0	148	0
Net income from discontinued operations										427
Net income	11,838	$ 6,491	$ 18,034	$ 1,048	4,095	$ 4,327	$ 15,377	$ 3,192	37,411	26,991	12,003
Preferred dividends									461	479	489
Net income available to common shareholders									36,950	26,512	11,514
Capital expenditures									6,615	2,042	2,693
Total assets	2,331,476				1,944,114				2,331,476	1,944,114
Goodwill	2,350				19,630				2,350	19,630	18,480	$ 18,480
Operating Segments | CoRe Banking
Information About the Reportable Segments
Interest income									75,812	75,874	63,762
Interest expense									10,400	18,698	13,667
NET INTEREST INCOME									65,412	57,176	50,095
Provision for loan losses									16,649	1,622	2,386
Net interest income after provision for loan losses									48,763	55,554	47,709
Noninterest Income:
Mortgage fee income									247	657	585
Other income									30,082	23,033	6,479
Total noninterest income									30,329	23,690	7,064
Noninterest Expenses:
Salaries and employee benefits									28,801	19,067	14,924
Other expenses									33,298	25,070	20,081
Total noninterest expense									62,099	44,137	35,005
Income (loss) before income taxes									16,993	35,107	19,768
Income tax expense (benefit)									1,752	8,175	4,265
Net income (loss) from continuing operations										26,932
Income from discontinued operations, before income taxes										0
Income tax expense - discontinued operations										0
Net income from discontinued operations										0
Net income									15,241	26,932	15,503
Preferred dividends									0	0	0
Net income available to common shareholders									15,241	26,932	15,503
Capital expenditures									6,439	1,438	2,284
Total assets	2,343,556				1,953,975				2,343,556	1,953,975
Goodwill	2,350				2,748				2,350	2,748
Operating Segments | Mortgage Banking
Information About the Reportable Segments
Interest income									6,269	8,342	6,667
Interest expense									3,139	6,014	4,085
NET INTEREST INCOME									3,130	2,328	2,582
Provision for loan losses									(70)	167	54
Net interest income after provision for loan losses									3,200	2,161	2,528
Noninterest Income:
Mortgage fee income									33,722	41,040	32,880
Other income									29,768	1,289	(243)
Total noninterest income									63,490	42,329	32,637
Noninterest Expenses:
Salaries and employee benefits									21,550	28,432	23,927
Other expenses									5,074	8,136	8,608
Total noninterest expense									26,624	36,568	32,535
Income (loss) before income taxes									40,066	7,922	2,630
Income tax expense (benefit)									9,862	2,155	677
Net income (loss) from continuing operations										5,767
Income from discontinued operations, before income taxes										0
Income tax expense - discontinued operations										0
Net income from discontinued operations										0
Net income									30,204	5,767	1,953
Preferred dividends									0	0	0
Net income available to common shareholders									30,204	5,767	1,953
Capital expenditures									99	112	272
Total assets	58,140				248,382				58,140	248,382
Goodwill	0				16,882				0	16,882
Operating Segments | Financial Holding Company
Information About the Reportable Segments
Interest income									3	13	5
Interest expense									261	769	1,756
NET INTEREST INCOME									(258)	(756)	(1,751)
Provision for loan losses									0	0	0
Net interest income after provision for loan losses									(258)	(756)	(1,751)
Noninterest Income:
Mortgage fee income									0	0	0
Other income									6,685	6,268	6,411
Total noninterest income									6,685	6,268	6,411
Noninterest Expenses:
Salaries and employee benefits									11,278	8,676	7,373
Other expenses									5,265	4,851	4,309
Total noninterest expense									16,543	13,527	11,682
Income (loss) before income taxes									(10,116)	(8,015)	(7,022)
Income tax expense (benefit)									(2,082)	(1,880)	(1,569)
Net income (loss) from continuing operations										(6,135)
Income from discontinued operations, before income taxes										575
Income tax expense - discontinued operations										148
Net income from discontinued operations										427
Net income									(8,034)	(5,708)	(5,453)
Preferred dividends									461	479	489
Net income available to common shareholders									(8,495)	(6,187)	(5,942)
Capital expenditures									77	492	137
Total assets	284,943				216,411				284,943	216,411
Goodwill	0				0				0	0
Intercompany Eliminations
Information About the Reportable Segments
Interest income									(1,631)	(1,868)	(674)
Interest expense									(2,173)	(2,520)	(1,802)
NET INTEREST INCOME									542	652	1,128
Provision for loan losses									0	0	0
Net interest income after provision for loan losses									542	652	1,128
Noninterest Income:
Mortgage fee income									(542)	(652)	(1,128)
Other income									(8,125)	(7,031)	(6,344)
Total noninterest income									(8,667)	(7,683)	(7,472)
Noninterest Expenses:
Salaries and employee benefits									0	0	0
Other expenses									(8,125)	(7,031)	(6,344)
Total noninterest expense									(8,125)	(7,031)	(6,344)
Income (loss) before income taxes									0	0	0
Income tax expense (benefit)									0	0	0
Net income (loss) from continuing operations										0
Income from discontinued operations, before income taxes										0
Income tax expense - discontinued operations										0
Net income from discontinued operations										0
Net income									0	0	0
Preferred dividends									0	0	0
Net income available to common shareholders									0	0	0
Capital expenditures									0	0	$ 0
Total assets	(355,163)				(474,564)				(355,163)	(474,564)
Goodwill	$ 0				$ 0				$ 0	$ 0