Segment Information (Details) $ in Thousands	3 Months Ended
	Mar. 31, 2017 USD ($) Segment	Mar. 31, 2016 USD ($)
Segment Information [Abstract]
Number of business units | Segment	2
Revenue and income (loss) before income taxes for each business unit [Abstract]
Total revenue	$ 43,859	$ 41,747
Income (loss) before income taxes	(347)	1,376
Operating Segments [Member] | American Southern [Member]
Revenue and income (loss) before income taxes for each business unit [Abstract]
Total revenue	14,301	14,811
Income (loss) before income taxes	2,150	2,231
Operating Segments [Member] | Bankers Fidelity [Member]
Revenue and income (loss) before income taxes for each business unit [Abstract]
Total revenue	29,537	26,839
Income (loss) before income taxes	(835)	998
Corporate and Other [Member]
Revenue and income (loss) before income taxes for each business unit [Abstract]
Total revenue	21	97
Income (loss) before income taxes	$ (1,662)	$ (1,853)