Segment Reporting (Details) $ in Thousands	3 Months Ended				6 Months Ended
	Jun. 30, 2021 USD ($)	Mar. 31, 2021 USD ($)	Jun. 30, 2020 USD ($)	Mar. 31, 2020 USD ($)	Jun. 30, 2021 USD ($) segment	Jun. 30, 2020 USD ($)	Dec. 31, 2020 USD ($)
Segment Reporting Information [Line Items]
Number of reportable segments | segment					3
Interest income	$ 20,833		$ 21,774		$ 39,896	$ 42,473
Interest expense	1,778		3,316		3,336	7,844
NET INTEREST INCOME	19,055		18,458		36,560	34,629
Provision (release of allowance) for loan losses	(1,540)		6,596		(922)	7,734
Net interest income after provision (release of allowance) for loan losses	20,595		11,862		37,482	26,895
Total noninterest income	13,644		45,513		26,102	56,363
Noninterest Expenses:
Salaries and employee benefits	13,661		22,659		25,572	38,841
Other expense	9,742		10,674		16,949	19,148
Total noninterest expenses	23,403		33,333		42,521	57,989
Income before income taxes	10,836		24,042		21,063	25,269
Income tax expense (benefit)	1,673		6,008		3,842	6,187
Net income before noncontrolling interest	9,163	$ 8,058	18,034	$ 1,048	17,221	19,082
Net loss attributable to noncontrolling interest	84		0		111	0
Net income attributable to parent	9,247		18,034		17,332	19,082
Preferred dividends	0		115		35	229
Net income available to common shareholders	9,247		17,919		17,297	18,853
Capital expenditures	716		1,135		2,652	2,519
Assets	2,734,540				2,734,540		$ 2,331,476
Goodwill	4,119				4,119		2,350
Operating Segments | CoRe Banking
Segment Reporting Information [Line Items]
Interest income	20,736		19,182		39,695	37,956
Interest expense	1,290		3,027		2,382	6,865
NET INTEREST INCOME	19,446		16,155		37,313	31,091
Provision (release of allowance) for loan losses	(1,540)		6,598		(920)	7,730
Net interest income after provision (release of allowance) for loan losses	20,986		9,557		38,233	23,361
Total noninterest income	9,986		17,832		16,423	21,288
Noninterest Expenses:
Salaries and employee benefits	10,384		6,170		19,226	12,036
Other expense	11,578		9,124		19,607	15,783
Total noninterest expenses	21,962		15,294		38,833	27,819
Income before income taxes	9,010		12,095		15,823	16,830
Income tax expense (benefit)	1,168		2,880		2,317	3,892
Net income before noncontrolling interest	7,842		9,215		13,506	12,938
Net loss attributable to noncontrolling interest	84				111
Net income attributable to parent	7,926				13,617
Preferred dividends	0		0		0	0
Net income available to common shareholders	7,926		9,215		13,617	12,938
Capital expenditures	694		1,105		2,630	2,400
Assets	2,758,741				2,758,741		2,343,556
Goodwill	4,119				4,119		2,350
Operating Segments | Mortgage Banking
Segment Reporting Information [Line Items]
Interest income	98		3,538		202	5,956
Interest expense	0		1,517		0	2,904
NET INTEREST INCOME	98		2,021		202	3,052
Provision (release of allowance) for loan losses	0		(2)		(2)	4
Net interest income after provision (release of allowance) for loan losses	98		2,023		204	3,048
Total noninterest income	4,546		28,562		10,953	36,347
Noninterest Expenses:
Salaries and employee benefits	0		13,584		0	21,468
Other expense	23		2,315		86	4,712
Total noninterest expenses	23		15,899		86	26,180
Income before income taxes	4,621		14,686		11,071	13,215
Income tax expense (benefit)	1,120		3,800		2,684	3,451
Net income before noncontrolling interest	3,501		10,886		8,387	9,764
Net loss attributable to noncontrolling interest	0				0
Net income attributable to parent	3,501				8,387
Preferred dividends	0		0		0	0
Net income available to common shareholders	3,501		10,886		8,387	9,764
Capital expenditures	22		30		22	99
Assets	49,767				49,767		58,140
Goodwill	0				0		0
Operating Segments | Financial Holding Company
Segment Reporting Information [Line Items]
Interest income	0		1		1	2
Interest expense	490		23		956	58
NET INTEREST INCOME	(490)		(22)		(955)	(56)
Provision (release of allowance) for loan losses	0		0		0	0
Net interest income after provision (release of allowance) for loan losses	(490)		(22)		(955)	(56)
Total noninterest income	2,309		1,679		3,890	3,183
Noninterest Expenses:
Salaries and employee benefits	3,277		2,905		6,346	5,337
Other expense	1,337		1,491		2,420	2,566
Total noninterest expenses	4,614		4,396		8,766	7,903
Income before income taxes	(2,795)		(2,739)		(5,831)	(4,776)
Income tax expense (benefit)	(615)		(672)		(1,159)	(1,156)
Net income before noncontrolling interest	(2,180)		(2,067)		(4,672)	(3,620)
Net loss attributable to noncontrolling interest	0				0
Net income attributable to parent	(2,180)				(4,672)
Preferred dividends	0		115		35	229
Net income available to common shareholders	(2,180)		(2,182)		(4,707)	(3,849)
Capital expenditures	0		0		0	20
Assets	295,735				295,735		284,943
Goodwill	0				0		0
Intercompany Eliminations
Segment Reporting Information [Line Items]
Interest income	(1)		(947)		(2)	(1,441)
Interest expense	(2)		(1,251)		(2)	(1,983)
NET INTEREST INCOME	1		304		0	542
Provision (release of allowance) for loan losses	0		0		0	0
Net interest income after provision (release of allowance) for loan losses	1		304		0	542
Total noninterest income	(3,197)		(2,560)		(5,164)	(4,455)
Noninterest Expenses:
Salaries and employee benefits	0		0		0	0
Other expense	(3,196)		(2,256)		(5,164)	(3,913)
Total noninterest expenses	(3,196)		(2,256)		(5,164)	(3,913)
Income before income taxes	0		0		0	0
Income tax expense (benefit)	0		0		0	0
Net income before noncontrolling interest	0		0		0	0
Net loss attributable to noncontrolling interest	0				0
Net income attributable to parent	0				0
Preferred dividends	0		0		0	0
Net income available to common shareholders	0		0		0	0
Capital expenditures	0		$ 0		0	$ 0
Assets	(369,703)				(369,703)		(355,163)
Goodwill	$ 0				$ 0		$ 0