Segment Information (Details) $ in Thousands	3 Months Ended
	Mar. 31, 2016 USD ($) Segment	Mar. 31, 2015 USD ($)
Segment Information [Abstract]
Number of business units | Segment	2
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	$ 41,747	$ 40,949
Income before income taxes	1,376	1,010
Corporate and Other [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	97	107
Income before income taxes	(1,853)	(2,029)
American Southern [Member] | Operating Segments [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	14,811	14,772
Income before income taxes	2,231	1,849
Bankers Fidelity [Member] | Operating Segments [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	26,839	26,070
Income before income taxes	$ 998	$ 1,190