Note 4 - Loans - Activity in Accretable Yield on PCI loans (Details) - USD ($) $ in Thousands		12 Months Ended
		Dec. 31, 2020	Dec. 31, 2019	Dec. 31, 2018
Beginning balance		$ 14,464	$ 17,229	$ 22,853
Accretion		(2,497)	(4,267)	(7,532)
Reclassifications from nonaccretable difference(1)	[1]		1,457	1,778
Other changes, net		(14,464)	45	130
Additions		8,152
Ending balance		5,655	14,464	17,229
Peoples Bank of Virginia [Member]
Beginning balance		1,890	2,590	3,388
Accretion		0	(950)	(1,263)
Reclassifications from nonaccretable difference(1)	[1]		17	8
Other changes, net		(1,890)	233	457
Additions		0
Ending balance		0	1,890	2,590
Waccamaw Bank [Member]
Beginning balance		12,574	14,639	19,465
Accretion		0	(3,317)	(6,269)
Reclassifications from nonaccretable difference(1)	[1]		1,440	1,770
Other changes, net		(12,574)	(188)	(327)
Additions		0
Ending balance		0	12,574	14,639
Highlands [Member]
Beginning balance		0	0	0
Accretion		(2,497)	0	0
Reclassifications from nonaccretable difference(1)	[1]		0	0
Other changes, net		0	0	0
Additions		8,152
Ending balance		$ 5,655	$ 0	$ 0

[1] Represents changes attributable to expected loss assumptions