Segment Information (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended
	Mar. 31, 2015 Segment	Mar. 31, 2014
Segment Information [Abstract]
Number of business units	2
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	$ 40,949	$ 41,160
Income before income taxes	1,010	993
Corporate and Other [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	107	121
Income before income taxes	(2,029)	(1,712)
American Southern [Member] | Operating Segments [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	14,772	14,201
Income before income taxes	1,849	1,057
Bankers Fidelity [Member] | Operating Segments [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	26,070	26,838
Income before income taxes	$ 1,190	$ 1,648