Segment Information (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended
	Mar. 31, 2014 Segment	Mar. 31, 2013
Segment Information [Abstract]
Number of business units	2
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	$ 41,160	$ 36,650
Income before income taxes	993	1,011
American Southern [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	14,201	10,490
Income before income taxes	1,057	1,442
Bankers Fidelity [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	26,838	25,938
Income before income taxes	1,648	1,037
Corporate and Other [Member]
Revenue and income before income taxes for each business unit [Abstract]
Total revenue	121	222
Income before income taxes	$ (1,712)	$ (1,468)