Consolidated Statements of Cash Flows - USD ($)	12 Months Ended
	Dec. 31, 2020	Dec. 31, 2019	Dec. 31, 2018
Cash Flows from Operating Activities:
Net (loss) income	$ (3,819,000)	$ (2,817,000)	$ 3,196,000
Adjustments to reconcile net (loss) income to net cash (used in) provided by operating activities:
Amortization (accretion) of investment premiums (discounts), net	269,000	7,000	15,000
Amortization and accretion of purchase loan premiums and discounts	816,000	997,000	523,000
Amortization of debt issuance costs	112,000	112,000	97,000
Amortization of core deposit intangible	74,000	75,000	50,000
Amortization of servicing assets of sold SBA loans	22,000	16,000
Impairment of intangible assets	206,000
Purchase price adjustment expense related to acquisition activity	556,000
Provision for loan losses	2,170,000	4,971,000	1,303,000
Depreciation and amortization	1,505,000	1,600,000	1,486,000
Share-based compensation	159,000	214,000	220,000
Increase in deferred income taxes	(323,000)	(1,136,000)	(265,000)
Originations of SBA loans held for sale	(2,049,000)	(26,947,000)	(2,254,000)
Proceeds from sale of SBA loans held for sale	12,160,000	12,556,000	2,096,000
Gains on sale of SBA loans held for sale, net	(566,000)	(891,000)	(155,000)
Net loss on sale and write-down of other real estate owned	69,000	94,000
Changes in assets and liabilities:
(Increase) decrease in accrued interest and dividends receivable	(3,017,000)	163,000	(270,000)
Increase in other assets	(331,000)	(1,180,000)	(981,000)
(Decrease) increase in accrued expenses and other liabilities	(1,732,000)	251,000	211,000
Net cash provided by (used in) operating activities	6,281,000	(11,915,000)	5,272,000
Cash Flows from Investing Activities:
Proceeds from maturity or sales on available-for-sale securities		6,500,000	37,032,000
Principal repayments on available-for-sale securities	9,879,000	3,893,000	2,267,000
Purchases of available-for-sale securities	(11,248,000)	(18,072,000)	(18,562,000)
Purchases of other investments			(513,000)
Proceeds from maturity of other investments		513,000	512,000
Redemption (purchases) of Federal Reserve Bank stock	114,000	(31,000)	(364,000)
(Purchases) redemptions of Federal Home Loan Bank stock	(26,000)	451,000	961,000
Decrease in originated loans receivable, net	116,635,000	18,728,000	5,572,000
Purchases of loans receivable	(32,785,000)	(54,604,000)	(47,074,000)
Purchases of premises and equipment	(70,000)	(552,000)	(1,142,000)
Proceeds from sale of other real estate owned	425,000	897,000
Refund of (payment for) escrow deposit related to acquisition activity		500,000	(500,000)
Net cash used in business combination			(5,071,000)
Net cash provided by (used in) investing activities	82,924,000	(41,777,000)	(26,882,000)
Cash Flows from Financing Activities:
(Decrease) increase in deposits, net	(133,877,000)	26,254,000	59,658,000
Purchases of deposits	49,998,000
Repayments of FHLB borrowings	(10,000,000)		(29,800,000)
Proceeds from issuance of subordinated note, net			9,709,000
Principal repayments of note payable	(199,000)	(195,000)	(192,000)
Decrease in advances from borrowers for taxes and insurance	105,000	755,000	97,000
Dividends paid on common stock	0	(155,000)	(154,000)
Net cash (used in) provided by financing activities	(93,973,000)	26,659,000	39,318,000
Net (decrease) increase in cash and cash equivalents	(4,768,000)	(27,033,000)	17,708,000
Cash and cash equivalents at beginning of period	39,404,000	66,437,000	48,729,000
Cash and cash equivalents at end of period	34,636,000	39,404,000	66,437,000
Supplemental Disclosures of Cash Flow Information:
Cash paid for interest	15,037,000	17,740,000	11,246,000
Cash (refund) paid for income taxes, net	(659,000)	22,000	1,243,000
Non-cash transactions:
Purchase of premises and equipment	290,000	181,000	415,000
Increase in accrued expense and other liabilities	(290,000)	(181,000)	(415,000)
Purchases of available-for-sale securities		578,000
Increase in accrued expense and other liabilities		(578,000)
Transfers of loans receivable to other real estate owned		446,000	1,954,000
Transfers of loans receivable to loans held for sale	5,022,000
Operating lease right-of-use assets	40,000	3,160,000
Operating lease liabilities	(40,000)	(3,364,000)
Accrued rent payable - adoption ASC 842	22,000	93,000
Capitalized servicing assets	137,000	180,000
Business Combination Non-Cash Disclosures:
Assets acquired in business combination (net of cash received)			60,173,000
Liabilities acquired in business combination			(56,123,000)
Contingent liability assumed in business combination		621,000	(707,000)
Decrease in escrow deposit related to acquisition activity	(657,000)
Decrease in liabilities related to acquisition activity	15,000
Decrease in contingent consideration related to acquisition activity	86,000
Interest Rate Swap [Member]
Non-cash transactions:
Increase in interest rate swaps assets	493,000
Increase in interest rate swaps liabilities	(493,000)
SBA CARES Act Paycheck Protection Program [Member]
Non-cash transactions:
Transfers of SBA loans held for sale to loans receivable	$ 9,542,000