Segment Information (Details) $ in Thousands	3 Months Ended
	Mar. 31, 2021 USD ($) Segment	Mar. 31, 2020 USD ($)	Dec. 31, 2020 USD ($)
Segment Information [Abstract]
Number of business units | Segment	2
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	$ 383,127		$ 405,187
Revenues	49,075	$ 39,410
Loss before income taxes	(547)	(10,227)
Operating Segments [Member] | American Southern [Member]
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	145,081		158,808
Revenues	17,526	15,227
Loss before income taxes	1,490	878
Operating Segments [Member] | Bankers Fidelity [Member]
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	224,844		236,197
Revenues	31,540	24,873
Loss before income taxes	134	(8,781)
Corporate and Other [Member]
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	13,202		$ 10,182
Revenues	9	(690)
Loss before income taxes	$ (2,171)	$ (2,324)