Segment Reporting (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2019	Sep. 30, 2018	Sep. 30, 2019	Sep. 30, 2018
Segment Reporting Information [Line Items]
Interest income	$ 21,038	$ 18,176	$ 61,131	$ 50,174
Interest expense	6,004	4,652	17,596	12,530
NET INTEREST INCOME	15,034	13,524	43,535	37,644
Provision for loan losses	657	1,069	1,557	2,148
Net interest income after provision for loan losses	14,377	12,455	41,978	35,496
Noninterest Income:
Mortgage fee income	11,496	9,008	28,030	24,634
Other income	3,200	1,503	21,818	5,711
Total noninterest income	14,696	10,511	49,848	30,345
Noninterest Expenses:
Salaries and employee benefits	15,438	11,520	40,452	34,487
Other expense	7,942	6,897	21,766	19,918
Total noninterest expenses	23,380	18,417	62,218	54,405
Income from continuing operations, before income taxes	5,693	4,549	29,608	11,436
Income tax (benefit) - continuing operations	1,347	970	7,139	2,432
Net income from continuing operations	4,346	3,579	22,469	9,004
Income (loss) from discontinued operations, before income taxes	(25)	0	575	0
Income tax expense (benefit) - discontinued operations	(6)	0	148	0
Net income (loss) from discontinued operations	(19)	0	427	0
Net income	4,327	3,579	22,896	9,004
Preferred dividends	121	123	364	366
Net income available to common shareholders	4,206	3,456	22,532	8,638
Capital expenditures	505	1,001	1,134	2,164
Assets, beginning balance			1,750,969	1,534,302
Assets, ending balance	1,961,952	1,723,104	1,961,952	1,723,104
Goodwill, Beginning Balance			18,480	18,480
Goodwill, Ending Balance	19,630	18,480	19,630	18,480
Operating Segments | Commercial & Retail Banking
Segment Reporting Information [Line Items]
Interest income	19,299	16,506	56,446	45,772
Interest expense	4,806	3,664	14,303	9,503
NET INTEREST INCOME	14,493	12,842	42,143	36,269
Provision for loan losses	625	1,025	1,497	2,067
Net interest income after provision for loan losses	13,868	11,817	40,646	34,202
Noninterest Income:
Mortgage fee income	121	152	507	444
Other income	2,138	2,203	19,168	5,052
Total noninterest income	2,259	2,355	19,675	5,496
Noninterest Expenses:
Salaries and employee benefits	4,820	3,493	13,435	10,946
Other expense	6,113	5,274	16,958	14,803
Total noninterest expenses	10,933	8,767	30,393	25,749
Income from continuing operations, before income taxes	5,194	5,405	29,928	13,949
Income tax (benefit) - continuing operations	1,130	1,121	6,969	2,932
Net income from continuing operations	4,064	4,284	22,959	11,017
Income (loss) from discontinued operations, before income taxes	0	0	0	0
Income tax expense (benefit) - discontinued operations	0	0	0	0
Net income (loss) from discontinued operations	0	0	0	0
Net income	4,064	4,284	22,959	11,017
Preferred dividends	0	0	0	0
Net income available to common shareholders	4,064	4,284	22,959	11,017
Capital expenditures	412	808	915	1,820
Assets, beginning balance			1,753,932	1,531,496
Assets, ending balance	1,959,817	1,722,542	1,959,817	1,722,542
Goodwill, Beginning Balance			1,598	1,598
Goodwill, Ending Balance	2,748	1,598	2,748	1,598
Operating Segments | Mortgage Banking
Segment Reporting Information [Line Items]
Interest income	2,288	1,763	5,858	4,870
Interest expense	1,811	1,138	4,303	2,945
NET INTEREST INCOME	477	625	1,555	1,925
Provision for loan losses	32	44	60	81
Net interest income after provision for loan losses	445	581	1,495	1,844
Noninterest Income:
Mortgage fee income	11,587	9,246	28,076	25,071
Other income	1,112	(738)	2,723	485
Total noninterest income	12,699	8,508	30,799	25,556
Noninterest Expenses:
Salaries and employee benefits	8,318	6,047	20,515	18,289
Other expense	2,142	2,147	6,009	6,566
Total noninterest expenses	10,460	8,194	26,524	24,855
Income from continuing operations, before income taxes	2,684	895	5,770	2,545
Income tax (benefit) - continuing operations	725	229	1,574	654
Net income from continuing operations	1,959	666	4,196	1,891
Income (loss) from discontinued operations, before income taxes	0	0	0	0
Income tax expense (benefit) - discontinued operations	0	0	0	0
Net income (loss) from discontinued operations	0	0	0	0
Net income	1,959	666	4,196	1,891
Preferred dividends	0	0	0	0
Net income available to common shareholders	1,959	666	4,196	1,891
Capital expenditures	56	128	83	235
Assets, beginning balance			165,430	149,323
Assets, ending balance	272,007	170,931	272,007	170,931
Goodwill, Beginning Balance			16,882	16,882
Goodwill, Ending Balance	16,882	16,882	16,882	16,882
Operating Segments | Financial Holding Company
Segment Reporting Information [Line Items]
Interest income	9	1	12	3
Interest expense	156	333	728	1,433
NET INTEREST INCOME	(147)	(332)	(716)	(1,430)
Provision for loan losses	0	0	0	0
Net interest income after provision for loan losses	(147)	(332)	(716)	(1,430)
Noninterest Income:
Mortgage fee income	0	0	0	0
Other income	1,516	1,706	4,790	4,748
Total noninterest income	1,516	1,706	4,790	4,748
Noninterest Expenses:
Salaries and employee benefits	2,300	1,980	6,502	5,252
Other expense	1,254	1,145	3,662	3,124
Total noninterest expenses	3,554	3,125	10,164	8,376
Income from continuing operations, before income taxes	(2,185)	(1,751)	(6,090)	(5,058)
Income tax (benefit) - continuing operations	(508)	(380)	(1,404)	(1,154)
Net income from continuing operations	(1,677)	(1,371)	(4,686)	(3,904)
Income (loss) from discontinued operations, before income taxes	(25)	0	575	0
Income tax expense (benefit) - discontinued operations	(6)	0	148	0
Net income (loss) from discontinued operations	(19)	0	427	0
Net income	(1,696)	(1,371)	(4,259)	(3,904)
Preferred dividends	121	123	364	366
Net income available to common shareholders	(1,817)	(1,494)	(4,623)	(4,270)
Capital expenditures	37	65	136	109
Assets, beginning balance			196,537	184,599
Assets, ending balance	210,715	191,033	210,715	191,033
Goodwill, Beginning Balance			0	0
Goodwill, Ending Balance	0	0	0	0
Intercompany Eliminations
Segment Reporting Information [Line Items]
Interest income	(558)	(94)	(1,185)	(471)
Interest expense	(769)	(483)	(1,738)	(1,351)
NET INTEREST INCOME	211	389	553	880
Provision for loan losses	0	0	0	0
Net interest income after provision for loan losses	211	389	553	880
Noninterest Income:
Mortgage fee income	(212)	(390)	(553)	(881)
Other income	(1,566)	(1,668)	(4,863)	(4,574)
Total noninterest income	(1,778)	(2,058)	(5,416)	(5,455)
Noninterest Expenses:
Salaries and employee benefits	0	0	0	0
Other expense	(1,567)	(1,669)	(4,863)	(4,575)
Total noninterest expenses	(1,567)	(1,669)	(4,863)	(4,575)
Income from continuing operations, before income taxes	0	0	0	0
Income tax (benefit) - continuing operations	0	0	0	0
Net income from continuing operations	0	0	0	0
Income (loss) from discontinued operations, before income taxes	0	0	0	0
Income tax expense (benefit) - discontinued operations	0	0	0	0
Net income (loss) from discontinued operations	0	0	0	0
Net income	0	0	0	0
Preferred dividends	0	0	0	0
Net income available to common shareholders	0	0	0	0
Capital expenditures	0	0	0	0
Assets, beginning balance			(364,930)	(331,116)
Assets, ending balance	(480,587)	(361,402)	(480,587)	(361,402)
Goodwill, Beginning Balance			0	0
Goodwill, Ending Balance	$ 0	$ 0	$ 0	$ 0