CONSOLIDATED STATEMENTS OF CHANGES IN STOCKHOLDERS' EQUITY - USD ($) $ in Thousands	Common Stock [Member]	Additional Paid-In Capital [Member]	Retained Earnings [Member]	Accumulated Other Comprehensive Income (Loss) [Member]	Total
Balance at Dec. 31, 2016	$ 123	$ 104,884	$ 22,126	$ (789)	$ 126,344
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income			2,425		2,425
Change in unrealized loss on securities available for sale (net of tax benefit, $192)				(372)	(372)
Change in unrecognized loss on securities held to maturity for which a portion of OTTI has been recognized (net of tax, $4 and accretion, $8 and amounts recorded into other comprehensive income at transfer)				9	9
Dividends on common stock			(5,798)		(5,798)
Issuance of common stock for warrants exercised		449			449
Issuance of common stock under Stock Incentive Plan		555			555
Issuance of common stock in connection with Eastern Virginia Bankshares, Inc. merger	116	198,793			198,909
Reclassification adjustment from accumulated other comprehensive income to retained earnings for adoption of ASU 2018-02				255
Stock-based compensation expense		251			251
Balance at Dec. 31, 2017	239	304,932	18,753	(1,152)	322,772
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income			33,691		33,691
Changes in other comprehensive income (loss) on investment securities, net of tax and accretion				(1,208)	(1,208)
Dividends on common stock			(7,688)		(7,688)
Issuance of common stock under Stock Incentive Plan	1	442			443
Reclassification adjustment from accumulated other comprehensive income to retained earnings for adoption of ASU 2018-02			229	(229)
Stock-based compensation expense		280			280
Balance at Dec. 31, 2018	240	305,654	44,985	(2,589)	348,290
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income			33,167		33,167
Changes in other comprehensive income (loss) on investment securities, net of tax and accretion				3,372	3,372
Dividends on common stock			(8,690)		(8,690)
Issuance of common stock under Stock Incentive Plan	1	669			670
Stock-based compensation expense		432			432
Balance at Dec. 31, 2019	$ 241	$ 306,755	$ 69,462	$ 783	$ 377,241