Consolidated Statements of Cash Flows - USD ($)	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Cash Flows from Operating Activities:
Net income (loss)	$ (2,817,000)	$ 3,196,000	$ 4,147,000
Adjustments to reconcile net income to net cash provided by operating activities:
Amortization of investment premiums, net	7,000	15,000	86,000
Amortization and accretion of purchase loan premiums and discounts	997,000	523,000	650,000
Amortization of debt issuance costs	112,000	97,000	82,000
Amortization of core deposit intangible	75,000	50,000
Amortization of servicing assets of sold SBA loans	16,000
Provision (credit) for loan losses	4,971,000	1,303,000	(857,000)
Depreciation and amortization	1,600,000	1,486,000	1,269,000
Loss on sales of available-for-sale securities			(6,000)
Share-based compensation	214,000	220,000	146,000
(Increase) decrease in deferred income taxes	(1,136,000)	(265,000)	2,258,000
Originations of SBA loans held for sale	(26,947,000)	(2,254,000)
Proceeds from sale of SBA loans held for sale	12,556,000	2,096,000
Gains on sale of SBA loans held for sale, net	(891,000)	(155,000)
Net loss on sale of other real estate owned	94,000		9,000
Changes in assets and liabilities:
Decrease (increase) in accrued interest and dividends receivable	163,000	(270,000)	(770,000)
Increase in other assets	(1,180,000)	(981,000)	(2,000)
Increase in accrued expenses and other liabilities	251,000	211,000	278,000
Net cash (used) provided by operating activities	(11,915,000)	5,272,000	7,290,000
Cash Flows from Investing Activities:
Proceeds from maturity or sales on available-for-sale securities	6,500,000	37,032,000	16,929,000
Principal repayments on available-for-sale securities	3,893,000	2,267,000	2,361,000
Purchases of available-for-sale securities	(18,072,000)	(18,562,000)	(20,576,000)
Purchases of other investments		(513,000)	(512,000)
Proceeds from maturity of other investments	513,000	512,000
Purchases of Federal Reserve Bank stock	(31,000)	(364,000)	(393,000)
Redemptions (purchases) of Federal Home Loan Bank stock	451,000	961,000	(280,000)
Decrease (increase) in originated loans receivable, net	18,728,000	5,572,000	(63,139,000)
Purchases of loans receivable	(54,604,000)	(47,074,000)	(73,022,000)
Purchases of premises and equipment	(552,000)	(1,142,000)	(3,060,000)
Proceeds from sale of other real estate owned	897,000		842,000
Refund of (payment for) escrow deposit related to acquisition activity	500,000	(500,000)
Net cash used in business combination		(5,071,000)
Net cash used in investing activities	(41,777,000)	(26,882,000)	(140,850,000)
Cash Flows from Financing Activities:
Increase in deposits, net	26,254,000	59,658,000	108,115,000
Repayments of FHLB borrowings, net		(29,800,000)	(18,000,000)
Proceeds from issuance of subordinated note, net		9,709,000
Principal repayments of note payable	(195,000)	(192,000)	(189,000)
Decrease in advances from borrowers for taxes and insurance	755,000	97,000	153,000
Purchases of treasury stock			(2,000)
Dividends paid on common stock	(155,000)	(154,000)	(77,000)
Net cash provided by financing activities	26,659,000	39,318,000	90,000,000
Net (decrease) increase in cash and cash equivalents	(27,033,000)	17,708,000	(43,560,000)
Cash and cash equivalents at beginning of period	66,437,000	48,729,000	92,289,000
Cash and cash equivalents at end of period	39,404,000	66,437,000	48,729,000
Supplemental Disclosures of Cash Flow Information:
Cash paid for interest	17,740,000	11,246,000	6,424,000
Cash paid for income taxes	22,000	1,243,000	515,000
Non-cash transactions:
Purchase of premises and equipment	181,000	415,000	808,000
Increase in accrued expense and other liabilities	(181,000)	(415,000)	(808,000)
Purchases of available-for-sale securities	578,000
Increase in accrued expense and other liabilities	(578,000)
Transfers of loans receivable to other real estate owned	446,000	1,954,000
Recognition of operating lease right-of-use assets	3,160,000
Recognition of operating lease liabilities	(3,264,000)
Accrued rent payable - adoption ASC 842	93,000
Capitalized servicing assets	180,000
Business Combination Non-Cash Disclosures:
Assets acquired in business combination (net of cash received)		60,173,000
Liabilities acquired in business combination		56,123,000
Contingent liability assumed in business combination	$ 621,000	$ 707,000