Loans, Loan Ratings by Loan Class, Commercial Segment (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2014		Dec. 31, 2013
Credit scores by loan class for mortgage and installment segments [Abstract]
Accrued interest included in total	$ (4,318)		$ (4,579)
Subsidiary's outstanding payment plan insured by third party (in hundredths)	76.80%
Subsidiary's payment outstanding payment plan 2, insured by third party (in hundredths)	10.20%
Credit ratings of insurer or risk retention group counterparties [Abstract]
Payment Plan Receivables, Full Refund	41,884		48,077
Payment Plan Receivable, Partial Refund	5,574		5,053
Payment Plan Receivable, Other	7,086		7,508
Total	54,544		60,638
Commercial [Member]
Loan ratings by loan class, commercial segment [Abstract]
Non-watch 1-6	583,847		571,794
Watch 7-8	43,418		49,014
Substandard Accrual 9	8,584		10,681
Non Accrual 10-11	7,698		5,369
Commercial loans, Total	643,547		636,858
Commercial [Member] | Income Producing - Real Estate [Member]
Loan ratings by loan class, commercial segment [Abstract]
Non-watch 1-6	232,004		227,957
Watch 7-8	14,954		17,882
Substandard Accrual 9	1,984		3,895
Non Accrual 10-11	3,443		1,899
Commercial loans, Total	252,385		251,633
Commercial [Member] | Land, Land Development and Construction - Real Estate [Member]
Loan ratings by loan class, commercial segment [Abstract]
Non-watch 1-6	28,003		25,654
Watch 7-8	4,874		4,829
Substandard Accrual 9	445		317
Non Accrual 10-11	904		1,036
Commercial loans, Total	34,226		31,836
Commercial [Member] | Commercial and Industrial [Member]
Loan ratings by loan class, commercial segment [Abstract]
Non-watch 1-6	323,840		318,183
Watch 7-8	23,590		26,303
Substandard Accrual 9	6,155		6,469
Non Accrual 10-11	3,351		2,434
Commercial loans, Total	356,936		353,389
Commercial [Member] | Accrued interest included in total [Member]
Loan ratings by loan class, commercial segment [Abstract]
Non-watch 1-6	1,336		1,433
Watch 7-8	130		147
Substandard Accrual 9	30		44
Non Accrual 10-11	0		0
Commercial loans, Total	1,496		1,624
Mortgage [Member]
Credit scores by loan class for mortgage and installment segments [Abstract]
800 and above	45,736	[1]	46,415	[1]
750-799	129,090	[1]	133,977	[1]
700-749	103,646	[1]	105,953	[1]
650-699	78,077	[1]	80,928	[1]
600-649	50,504	[1]	51,308	[1]
550-599	30,820	[1]	31,527	[1]
500-549	18,802	[1]	19,298	[1]
Under 500	11,069	[1]	11,335	[1]
Unknown	10,013	[1]	8,168	[1]
Total	477,757	[1]	488,909	[1]
Accrued interest included in total	2,177	[1]	2,276	[1]
Mortgage [Member] | 1-4 Family [Member]
Credit scores by loan class for mortgage and installment segments [Abstract]
800 and above	23,475	[1]	23,924	[1]
750-799	58,164	[1]	60,728	[1]
700-749	56,805	[1]	58,269	[1]
650-699	47,072	[1]	49,771	[1]
600-649	34,714	[1]	34,991	[1]
550-599	24,248	[1]	24,616	[1]
500-549	14,486	[1]	14,823	[1]
Under 500	9,240	[1]	9,492	[1]
Unknown	6,311	[1]	4,809	[1]
Total	274,515	[1]	281,423	[1]
Accrued interest included in total	1,274	[1]	1,300	[1]
Mortgage [Member] | Resort Lending [Member]
Credit scores by loan class for mortgage and installment segments [Abstract]
800 and above	13,325	[1]	13,487	[1]
750-799	54,523	[1]	56,880	[1]
700-749	35,389	[1]	35,767	[1]
650-699	21,516	[1]	21,696	[1]
600-649	8,144	[1]	8,555	[1]
550-599	3,035	[1]	3,261	[1]
500-549	2,253	[1]	2,271	[1]
Under 500	1,150	[1]	1,160	[1]
Unknown	2,848	[1]	2,879	[1]
Total	142,183	[1]	145,956	[1]
Accrued interest included in total	614	[1]	650	[1]
Mortgage [Member] | Home Equity - 1st Lien [Member]
Credit scores by loan class for mortgage and installment segments [Abstract]
800 and above	3,985	[1]	3,650	[1]
750-799	4,885	[1]	4,560	[1]
700-749	3,266	[1]	3,289	[1]
650-699	2,305	[1]	2,316	[1]
600-649	2,545	[1]	2,621	[1]
550-599	1,122	[1]	1,165	[1]
500-549	625	[1]	644	[1]
Under 500	322	[1]	323	[1]
Unknown	246	[1]	233	[1]
Total	19,301	[1]	18,801	[1]
Accrued interest included in total	88	[1]	97	[1]
Mortgage [Member] | Home Equity - 2nd Lien [Member]
Credit scores by loan class for mortgage and installment segments [Abstract]
800 and above	4,951	[1]	5,354	[1]
750-799	11,518	[1]	11,809	[1]
700-749	8,186	[1]	8,628	[1]
650-699	7,184	[1]	7,145	[1]
600-649	5,101	[1]	5,141	[1]
550-599	2,415	[1]	2,485	[1]
500-549	1,438	[1]	1,560	[1]
Under 500	357	[1]	360	[1]
Unknown	608	[1]	247	[1]
Total	41,758	[1]	42,729	[1]
Accrued interest included in total	201	[1]	229	[1]
Installment [Member]
Credit scores by loan class for mortgage and installment segments [Abstract]
800 and above	28,884	[1]	29,741	[1]
750-799	67,357	[1]	66,924	[1]
700-749	39,641	[1]	39,866	[1]
650-699	26,531	[1]	27,549	[1]
600-649	10,906	[1]	11,544	[1]
550-599	7,271	[1]	7,925	[1]
500-549	4,769	[1]	5,060	[1]
Under 500	1,929	[1]	1,959	[1]
Unknown	1,694	[1]	2,176	[1]
Total	188,982	[1]	192,744	[1]
Accrued interest included in total	645	[1]	679	[1]
Installment [Member] | Home Equity - 1st Lien [Member]
Credit scores by loan class for mortgage and installment segments [Abstract]
800 and above	2,820	[1]	2,977	[1]
750-799	6,405	[1]	6,585	[1]
700-749	4,317	[1]	4,353	[1]
650-699	4,630	[1]	4,815	[1]
600-649	3,054	[1]	3,173	[1]
550-599	2,778	[1]	2,843	[1]
500-549	1,437	[1]	1,483	[1]
Under 500	733	[1]	751	[1]
Unknown	159	[1]	162	[1]
Total	26,333	[1]	27,142	[1]
Accrued interest included in total	105	[1]	114	[1]
Installment [Member] | Home Equity - 2nd Lien [Member]
Credit scores by loan class for mortgage and installment segments [Abstract]
800 and above	2,925	[1]	3,062	[1]
750-799	10,735	[1]	11,197	[1]
700-749	9,392	[1]	9,487	[1]
650-699	6,483	[1]	6,832	[1]
600-649	2,700	[1]	2,824	[1]
550-599	1,920	[1]	2,084	[1]
500-549	1,617	[1]	1,715	[1]
Under 500	689	[1]	663	[1]
Unknown	41	[1]	80	[1]
Total	36,502	[1]	37,944	[1]
Accrued interest included in total	135	[1]	144	[1]
Installment [Member] | Loans Not Secured By Real Estate [Member]
Credit scores by loan class for mortgage and installment segments [Abstract]
800 and above	23,090	[1]	23,649	[1]
750-799	49,649	[1]	48,585	[1]
700-749	25,296	[1]	25,343	[1]
650-699	14,850	[1]	15,256	[1]
600-649	4,914	[1]	5,289	[1]
550-599	2,375	[1]	2,785	[1]
500-549	1,594	[1]	1,732	[1]
Under 500	481	[1]	516	[1]
Unknown	1,456	[1]	1,892	[1]
Total	123,705	[1]	125,047	[1]
Accrued interest included in total	386	[1]	399	[1]
Installment [Member] | Other [Member]
Credit scores by loan class for mortgage and installment segments [Abstract]
800 and above	49	[1]	53	[1]
750-799	568	[1]	557	[1]
700-749	636	[1]	683	[1]
650-699	568	[1]	646	[1]
600-649	238	[1]	258	[1]
550-599	198	[1]	213	[1]
500-549	121	[1]	130	[1]
Under 500	26	[1]	29	[1]
Unknown	38	[1]	42	[1]
Total	2,442	[1]	2,611	[1]
Accrued interest included in total	19	[1]	22	[1]
AM Best Rating A+ [Member]
Credit ratings of insurer or risk retention group counterparties [Abstract]
Payment Plan Receivables, Full Refund	0
Payment Plan Receivable, Partial Refund	20
Payment Plan Receivable, Other	0
Total	20
AM Best Rating, A Ratings [Member]
Credit ratings of insurer or risk retention group counterparties [Abstract]
Payment Plan Receivables, Full Refund	17,174		20,203
Payment Plan Receivable, Partial Refund	4,565		4,221
Payment Plan Receivable, Other	0		0
Total	21,739		24,424
AM Best Rating, A Minus Rating [Member]
Credit ratings of insurer or risk retention group counterparties [Abstract]
Payment Plan Receivables, Full Refund	2,623		4,058
Payment Plan Receivable, Partial Refund	989		832
Payment Plan Receivable, Other	7,080		7,496
Total	10,692		12,386
Not Rated [Member]
Credit ratings of insurer or risk retention group counterparties [Abstract]
Payment Plan Receivables, Full Refund	22,087		23,816
Payment Plan Receivable, Partial Refund	0		0
Payment Plan Receivable, Other	6		12
Total	$ 22,093		$ 23,828

[1] Credit scores have been updated within the last twelve months.