Segment Information (Details) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2019 USD ($)	Jun. 30, 2018 USD ($)	Jun. 30, 2019 USD ($) Segment	Jun. 30, 2018 USD ($)	Dec. 31, 2018 USD ($)
Segment Information [Abstract]
Number of business units | Segment			2
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	$ 371,730		$ 371,730		$ 344,274
Revenue	43,127	$ 49,443	98,145	$ 89,983
Income (loss) before income taxes	(5,589)	4,033	(304)	(2,318)
Operating Segments [Member] | American Southern [Member]
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	142,059		142,059		122,724
Revenue	15,740	14,643	30,975	28,176
Income (loss) before income taxes	1,396	1,929	3,378	2,897
Operating Segments [Member] | Bankers Fidelity [Member]
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	206,513		206,513		195,663
Revenue	31,244	31,641	65,620	61,754
Income (loss) before income taxes	(1,998)	261	(2,494)	(2,274)
Corporate and Other [Member]
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	148,424		148,424		134,643
Revenue	(1,261)	5,939	6,617	5,419
Income (loss) before income taxes	(4,987)	1,843	(1,188)	(2,941)
Adjustments & Eliminations [Member]
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	(125,266)		(125,266)		$ (108,756)
Revenue	$ (2,596)	$ (2,780)	$ (5,067)	$ (5,366)