Consolidated Statements of Changes in Stockholders' Equity - USD ($) $ in Thousands	Total	Chartwell	Preferred stock	Common stock	Common stock Chartwell	Additional paid-in capital	Additional paid-in capital Chartwell	Retained earnings	Accumulated other comprehensive income (loss)	Treasury stock
Beginning balance (in shares) at Dec. 31, 2017			783	10,495,704						51,077
Beginning balance at Dec. 31, 2017	$ 150,192		$ 7,834	$ 10,496		$ 98,698		$ 37,236	$ (2,988)	$ (1,084)
Increase (Decrease) in Stockholders' Equity
Net income	12,003							12,003
Other comprehensive income (loss)	(3,074)								(3,074)
Cash dividends paid	(1,220)							(1,220)
Dividends on preferred stock	(489)							(489)
Stock-based compensation	1,267					1,267
Common stock options exercised (in shares)				162,666
Common stock options exercised	2,129			$ 161		1,968
Restricted stock units vested	1					(1)
Stranded AOCI								646	(646)
Market-to-market on equity positions								98	(98)
Common stock issued from subordinated debt conversion, net of costs (in shares)				1,000,000
Common stock issued from subordinated debt conversion, net of costs	15,965			$ 1,000		14,965
Common stock issued related to Paladin acquisition	0
Ending balance (in shares) at Dec. 31, 2018			783	11,658,370						51,077
Ending balance at Dec. 31, 2018	176,773		$ 7,834	$ 11,658		116,897		48,274	(6,806)	$ (1,084)
Increase (Decrease) in Stockholders' Equity
Net income	26,991							26,991
Other comprehensive income (loss)	5,485								5,485
Cash dividends paid	(2,290)							(2,290)
Dividends on preferred stock	(479)							(479)
Stock-based compensation	1,759					1,759
Common stock options exercised (in shares)				210,050
Common stock options exercised	2,164			$ 210		1,954
Restricted stock units vested (in shares)				9,576
Restricted stock units vested	10					(10)
Common stock issued from subordinated debt conversion, net of costs (in shares)				62,500
Common stock issued from subordinated debt conversion, net of costs	1,000			$ 62		938
Common stock issued related to acquisitions (in shares)					54,870
Common stock issued related to Paladin acquisition	0	$ 1,033			$ 55		$ 978
Redemption of preferred stock (in shares)			(50)
Redemption of preferred stock	(500)		$ (500)
Ending balance (in shares) at Dec. 31, 2019			733	11,995,366						51,077
Ending balance at Dec. 31, 2019	211,936		$ 7,334	$ 11,995		122,516		72,496	(1,321)	$ (1,084)
Increase (Decrease) in Stockholders' Equity
Net income	37,411							37,411
Other comprehensive income (loss)	3,547								3,547
Cash dividends paid	(4,275)							(4,275)
Dividends on preferred stock	(461)							(461)
Stock-based compensation	$ 2,353					2,353
Common stock options exercised (in shares)	305,697			305,697
Common stock options exercised	$ 4,459			$ 306		4,153
Restricted stock units vested (in shares)				53,981						525
Restricted stock units vested	(77)			$ 54		(124)				$ (7)
Common stock repurchased (in shares)										796,414
Common stock repurchased	(15,650)									$ (15,650)
Common stock issued related to acquisitions (in shares)				19,278
Common stock issued related to Paladin acquisition	240			$ 19		221
Ending balance (in shares) at Dec. 31, 2020			733	12,374,322						848,016
Ending balance at Dec. 31, 2020	$ 239,483		$ 7,334	$ 12,374		$ 129,119		$ 105,171	$ 2,226	$ (16,741)