Net Income Per Common Share (Details) - USD ($) $ / shares in Units, $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2018	Sep. 30, 2017	Sep. 30, 2018	Sep. 30, 2017
Numerator for basic earnings per share:
Net income	$ 3,579	$ 2,318	$ 9,004	$ 6,152
Less: Dividends on preferred stock	123	123	366	374
Net income available to common shareholders - basic	3,456	2,195	8,638	5,778
Numerator for diluted earnings per share:
Net income available to common shareholders - basic	3,456	2,195	8,638	5,778
Add: Dividends on convertible preferred stock	123	0	366	0
Add: Interest on subordinated debt (tax effected)	228	352	0	0
Net income available to common shareholders - diluted	$ 3,807	$ 2,547	$ 9,004	$ 5,778
Denominator:
Total average shares outstanding (in shares)	11,416,202	10,443,443	10,845,166	10,262,944
Effect of dilutive convertible preferred stock (in shares)	489,625	0	489,625	0
Effect of dilutive convertible subordinated debt (in shares)	900,000	1,837,500	0	0
Effect of dilutive stock options (in shares)	307,432	129,127	355,523	25,590
Total diluted average shares outstanding (in shares)	13,113,259	12,410,070	11,690,314	10,288,534
Earnings per share from continuing operations - basic (in dollars per share)	$ 0.30	$ 0.21	$ 0.80	$ 0.56
Earnings per share from continuing operations - diluted (in dollars per share)	$ 0.29	$ 0.21	$ 0.77	$ 0.56
Stock option
Antidilutive Securities Excluded from Computation of Earnings Per Share [Line Items]
Antidilutive securities excluded form computation of earnings per share (in shares)	0	490,000	900,000	2,300,000
Restricted Stock Units (RSUs)
Antidilutive Securities Excluded from Computation of Earnings Per Share [Line Items]
Antidilutive securities excluded form computation of earnings per share (in shares)	54,000		44,000