Consolidated Statements of Operations (Unaudited) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019
Interest income:
Interest and fees on taxable loans	$ 24,135	$ 18,298	$ 65,941	$ 53,827
Interest and fees on tax-exempt loans	548	409	1,652	1,249
Interest and dividends on taxable investment securities	3,758	6,652	15,612	21,134
Interest and dividends on tax-exempt investment securities	20	72	59	131
Interest on federal funds sold and other interest-earning assets	99	777	438	1,631
Total interest income	28,560	26,208	83,702	77,972
Interest expense:
Demand- interest bearing	3,056	3,753	9,333	11,897
Money market and savings	1,613	1,813	4,827	4,893
Time deposits	884	1,123	3,138	2,608
Other borrowings	77	137	293	681
Total interest expense	5,630	6,826	17,591	20,079
Net interest income	22,930	19,382	66,111	57,893
Provision for loan losses	850	450	2,800	750
Net interest income after provision for loan losses	22,080	18,932	63,311	57,143
Non-interest income:
Non-interest income	3,224	2,036	7,712	5,625
Gain on sales of SBA loans	649	944	1,567	2,593
Gain on sale of investment securities	279	520	2,760	1,103
Other non-interest income	1,090	46	1,546	175
Total non-interest income	10,031	6,554	25,000	18,525
Non-interest expenses:
Salaries and employee benefits	14,596	14,314	41,154	40,378
Occupancy	3,560	2,994	10,294	8,270
Depreciation and amortization	1,964	1,740	6,081	4,700
Legal	261	462	810	1,024
Other real estate owned	80	799	437	1,653
Appraisal and other loan expenses	619	476	1,580	1,327
Advertising	386	698	1,055	1,467
Data processing	1,606	1,434	4,747	3,780
Insurance	279	301	836	752
Professional fees	679	661	2,069	1,864
Debit card processing	915	526	2,639	1,689
Regulatory assessments and costs	625	62	1,930	904
Taxes, other	303	288	789	782
Goodwill impairment	5,011	0	5,011	0
Other operating expenses	2,696	3,069	8,084	8,412
Total non-interest expense	33,580	27,824	87,516	77,002
Income (loss) before benefit for income taxes	(1,469)	(2,338)	795	(1,334)
Benefit for income taxes	(503)	(516)	(158)	(319)
Net income (loss)	$ (966)	$ (1,822)	$ 953	$ (1,015)
Basic (in dollars per share)	$ (0.02)	$ (0.03)	$ 0.02	$ (0.02)
Diluted (in dollars per share)	$ (0.02)	$ (0.03)	$ 0.02	$ (0.02)
Loan and Servicing Fees [Member]
Non-interest income:
Non-interest income	$ 917	$ 257	$ 2,152	$ 1,156
Mortgage Banking [Member]
Non-interest income:
Non-interest income	4,962	2,797	10,809	8,048
Deposit Account [Member]
Non-interest income:
Non-interest income	$ 2,134	$ 1,990	$ 6,166	$ 5,450