Net Income Per Common Share (Details) - USD ($) $ / shares in Units, $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2019	Sep. 30, 2018	Sep. 30, 2019	Sep. 30, 2018
Numerator for basic earnings per share:
Net income from continuing operations	$ 4,346	$ 3,579	$ 22,469	$ 9,004
Less: Dividends on preferred stock	121	123	364	366
Net income from continuing operations available to common shareholders - basic	4,225	3,456	22,105	8,638
Net income from discontinued operations available to common shareholders - basic and diluted	(19)	0	427	0
Net income available to common shareholders	4,206	3,456	22,532	8,638
Numerator for diluted earnings per share:
Net income from continuing operations available to common shareholders - basic	4,225	3,456	22,105	8,638
Add: Dividends on convertible preferred stock	0	123	0	366
Add: Interest on subordinated debt (tax effected)	0	228	0	0
Net income from continuing operations available to common shareholders - diluted	$ 4,225	$ 3,807	$ 22,105	$ 9,004
Denominator:
Total average shares outstanding (in shares)	11,731,774	11,416,202	11,661,581	10,845,166
Effect of dilutive convertible preferred stock (in shares)	0	489,625	0	489,625
Effect of dilutive convertible subordinated debt (in shares)	0	900,000	0	0
Effect of dilutive stock options and restricted stock units (in shares)	366,561	307,432	295,804	355,523
Total diluted average shares outstanding (in shares)	12,098,335	13,113,259	11,957,385	11,690,314
Earnings per share from continuing operations - basic (in dollars per share)	$ 0.36	$ 0.30	$ 1.89	$ 0.80
Earnings per share from discontinued operations - basic (in dollars per share)	0	0	0.04	0
Earnings per share - basic (in dollars per share)	0.36	0.30	1.93	0.80
Earnings per share from continuing operations - diluted (in dollars per share)	0.35	0.29	1.84	0.77
Earnings per share from discontinued operations - diluted (in dollars per share)	0	0	0.04	0
Earnings per share - diluted (in dollars per share)	$ 0.35	$ 0.29	$ 1.88	$ 0.77
Stock option
Antidilutive Securities Excluded from Computation of Earnings Per Share [Line Items]
Antidilutive securities excluded form computation of earnings per share (in shares)	389,000	377,000	396,000	1,200,000
Restricted Stock Units (RSUs)
Antidilutive Securities Excluded from Computation of Earnings Per Share [Line Items]
Antidilutive securities excluded form computation of earnings per share (in shares)	116,000	54,000	137,000	44,000