Segment Information (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012
Revenue and income (loss) before tax for each business unit [Abstract]
Insurance premiums	$ 145,630	$ 126,743
Insurance benefits and losses incurred	100,372	89,817
Expenses deferred	(10,336)	(12,325)
Amortization and depreciation expense	9,560	10,920
Other expenses	54,567	46,334
Total benefits and expenses	154,163	134,746
Investment income	10,809	11,504
Other income	189	147
Operating income (loss)	2,465	3,648
Net realized gains	8,741	1,434
Income before income taxes	11,206	5,082
Total revenues	165,369	139,828
Intangibles	2,544	2,128
Total assets	319,381	320,177
American Southern [Member]
Revenue and income (loss) before tax for each business unit [Abstract]
Insurance premiums	45,851	37,471
Insurance benefits and losses incurred	30,197	27,337
Expenses deferred	(7,106)	(8,515)
Amortization and depreciation expense	7,440	9,009
Other expenses	15,777	11,758
Total benefits and expenses	46,308	39,589
Underwriting income (loss)	(457)	(2,118)
Investment income	4,308	4,560
Other income	12	0
Operating income (loss)	3,863	2,442
Net realized gains	3,767	383
Income before income taxes	7,630	2,825
Total revenues	53,938	42,414
Intangibles	1,350	1,350
Total assets	126,861	130,092
Bankers Fidelity [Member]
Revenue and income (loss) before tax for each business unit [Abstract]
Insurance premiums	99,779	89,272
Insurance benefits and losses incurred	70,175	62,480
Expenses deferred	(3,230)	(3,810)
Amortization and depreciation expense	2,120	1,911
Other expenses	31,742	27,674
Total benefits and expenses	100,807	88,255
Underwriting income (loss)	(1,028)	1,017
Investment income	5,920	6,195
Other income	40	48
Operating income (loss)	4,932	7,260
Net realized gains	4,330	1,051
Income before income taxes	9,262	8,311
Total revenues	110,069	96,566
Intangibles	1,194	778
Total assets	156,484	161,078
Corporate & Other [Member]
Revenue and income (loss) before tax for each business unit [Abstract]
Insurance premiums	0	0
Insurance benefits and losses incurred	0	0
Expenses deferred	0	0
Amortization and depreciation expense	0	0
Other expenses	15,076	14,340
Total benefits and expenses	15,076	14,340
Investment income	2,338	2,582
Other income	6,408	5,704
Operating income (loss)	(6,330)	(6,054)
Net realized gains	644	0
Income before income taxes	(5,686)	(6,054)
Total revenues	9,390	8,286
Intangibles	0	0
Total assets	141,304	153,912
Adjustments & Eliminations [Member]
Revenue and income (loss) before tax for each business unit [Abstract]
Insurance premiums	0	0
Insurance benefits and losses incurred	0	0
Expenses deferred	0	0
Amortization and depreciation expense	0	0
Other expenses	(8,028)	(7,438)
Total benefits and expenses	(8,028)	(7,438)
Investment income	(1,757)	(1,833)
Other income	(6,271)	(5,605)
Operating income (loss)	0	0
Net realized gains	0	0
Income before income taxes	0	0
Total revenues	(8,028)	(7,438)
Intangibles	0	0
Total assets	$ (105,268)	$ (124,905)