Segment Information (Details) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2015 USD ($)	Sep. 30, 2014 USD ($)	Sep. 30, 2015 USD ($) Segment	Sep. 30, 2014 USD ($)
Segment Information [Abstract]
Number of business units | Segment			2
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	$ 40,359	$ 42,656	$ 126,080	$ 125,402
Income before income taxes	365	1,587	5,564	3,566
Corporate and Other [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	90	928	485	1,195
Income before income taxes	(1,497)	(964)	(5,061)	(3,962)
American Southern [Member] | Operating Segments [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	14,899	14,819	45,335	43,167
Income before income taxes	1,572	1,500	5,245	3,695
Bankers Fidelity [Member] | Operating Segments [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	25,370	26,909	80,260	81,040
Income before income taxes	$ 290	$ 1,051	$ 5,380	$ 3,833