Segment Reporting (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2020	Mar. 31, 2019
Segment Reporting Information [Line Items]
Interest income	$ 20,699	$ 19,623
Interest expense	4,528	5,651
NET INTEREST INCOME	16,171	13,972
Provision for loan losses	1,138	300
Net interest income after provision for loan losses	15,033	13,672
Noninterest Income:
Mortgage fee income	11,219	6,670
Other income	(369)	2,095
Total noninterest income	10,850	8,765
Noninterest Expenses:
Salaries and employee benefits	16,182	11,734
Other expense	8,474	6,714
Total noninterest expenses	24,656	18,448
Income before income taxes	1,227	3,989
Income tax (benefit) - continuing operations	179	797
Net income	1,048	3,192
Preferred dividends	114	121
Net income available to common shareholders - basic	934	3,071
Capital expenditures	1,384	115
Assets, beginning balance	1,944,114	1,750,969
Assets, ending balance	2,099,680	1,789,908
Goodwill, Beginning Balance	19,630	18,480
Goodwill, Ending Balance	19,630	18,480
Operating Segments | Commercial & Retail Banking
Segment Reporting Information [Line Items]
Interest income	18,774	18,327
Interest expense	3,838	4,754
NET INTEREST INCOME	14,936	13,573
Provision for loan losses	1,132	247
Net interest income after provision for loan losses	13,804	13,326
Noninterest Income:
Mortgage fee income	110	109
Other income	3,346	1,566
Total noninterest income	3,456	1,675
Noninterest Expenses:
Salaries and employee benefits	5,866	4,395
Other expense	6,659	5,352
Total noninterest expenses	12,525	9,747
Income before income taxes	4,735	5,254
Income tax (benefit) - continuing operations	1,012	1,054
Net income	3,723	4,200
Preferred dividends	0	0
Net income available to common shareholders - basic	3,723	4,200
Capital expenditures	1,295	89
Assets, beginning balance	1,953,975	1,753,932
Assets, ending balance	2,112,842	1,790,725
Goodwill, Beginning Balance	2,748	1,598
Goodwill, Ending Balance	2,748	1,598
Operating Segments | Mortgage Banking
Segment Reporting Information [Line Items]
Interest income	2,418	1,538
Interest expense	1,387	993
NET INTEREST INCOME	1,031	545
Provision for loan losses	6	53
Net interest income after provision for loan losses	1,025	492
Noninterest Income:
Mortgage fee income	11,347	6,697
Other income	(3,562)	476
Total noninterest income	7,785	7,173
Noninterest Expenses:
Salaries and employee benefits	7,884	5,159
Other expense	2,397	2,025
Total noninterest expenses	10,281	7,184
Income before income taxes	(1,471)	481
Income tax (benefit) - continuing operations	(349)	146
Net income	(1,122)	335
Preferred dividends	0	0
Net income available to common shareholders - basic	(1,122)	335
Capital expenditures	69	4
Assets, beginning balance	248,382	165,430
Assets, ending balance	337,445	175,218
Goodwill, Beginning Balance	16,882	16,882
Goodwill, Ending Balance	16,882	16,882
Operating Segments | Financial Holding Company
Segment Reporting Information [Line Items]
Interest income	1	1
Interest expense	35	285
NET INTEREST INCOME	(34)	(284)
Provision for loan losses	0	0
Net interest income after provision for loan losses	(34)	(284)
Noninterest Income:
Mortgage fee income	0	0
Other income	1,504	1,779
Total noninterest income	1,504	1,779
Noninterest Expenses:
Salaries and employee benefits	2,432	2,180
Other expense	1,075	1,061
Total noninterest expenses	3,507	3,241
Income before income taxes	(2,037)	(1,746)
Income tax (benefit) - continuing operations	(484)	(403)
Net income	(1,553)	(1,343)
Preferred dividends	114	121
Net income available to common shareholders - basic	(1,667)	(1,464)
Capital expenditures	20	22
Assets, beginning balance	216,411	196,537
Assets, ending balance	216,989	197,191
Goodwill, Beginning Balance	0	0
Goodwill, Ending Balance	0	0
Intercompany Eliminations
Segment Reporting Information [Line Items]
Interest income	(494)	(243)
Interest expense	(732)	(381)
NET INTEREST INCOME	238	138
Provision for loan losses	0	0
Net interest income after provision for loan losses	238	138
Noninterest Income:
Mortgage fee income	(238)	(136)
Other income	(1,657)	(1,726)
Total noninterest income	(1,895)	(1,862)
Noninterest Expenses:
Salaries and employee benefits	0	0
Other expense	(1,657)	(1,724)
Total noninterest expenses	(1,657)	(1,724)
Income before income taxes	0	0
Income tax (benefit) - continuing operations	0	0
Net income	0	0
Preferred dividends	0	0
Net income available to common shareholders - basic	0	0
Capital expenditures	0	0
Assets, beginning balance	(474,654)	(364,930)
Assets, ending balance	(567,596)	(373,226)
Goodwill, Beginning Balance	0	0
Goodwill, Ending Balance	$ 0	$ 0