Loans and the Allowance for Loan Losses, Impaired Loans (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended	12 Months Ended
	Mar. 31, 2014	Dec. 31, 2013
Financing Receivable, Impaired [Line Items]
Unpaid Principal Balance	$ 21,897	$ 22,466
Without Valuation Allowance	11,698	11,414
With Valuation Allowance	7,470	8,371
Associated Allowance	804	1,693
Average Recorded Investment	19,326	19,201
Interest Income Recognized	102	681
Total Mortgage Loans on Real Estate [Member]
Financing Receivable, Impaired [Line Items]
Unpaid Principal Balance	21,733	22,301
Without Valuation Allowance	11,683	11,265
With Valuation Allowance	7,321	8,356
Associated Allowance	655	1,693
Average Recorded Investment	19,162	19,140
Interest Income Recognized	102	674
Total Mortgage Loans on Real Estate [Member] | Residential 1-4 Family [Member]
Financing Receivable, Impaired [Line Items]
Unpaid Principal Balance	5,778	5,713
Without Valuation Allowance	4,471	1,542
With Valuation Allowance	1,094	4,009
Associated Allowance	148	1,383
Average Recorded Investment	5,494	5,152
Interest Income Recognized	18	102
Total Mortgage Loans on Real Estate [Member] | Commercial [Member]
Financing Receivable, Impaired [Line Items]
Unpaid Principal Balance	12,246	12,905
Without Valuation Allowance	6,938	6,882
With Valuation Allowance	3,588	4,300
Associated Allowance	227	307
Average Recorded Investment	10,613	10,631
Interest Income Recognized	76	591
Total Mortgage Loans on Real Estate [Member] | Construction [Member]
Financing Receivable, Impaired [Line Items]
Unpaid Principal Balance	3,249	3,309
Without Valuation Allowance	0	2,545
With Valuation Allowance	2,485	0
Associated Allowance	144	0
Average Recorded Investment	2,593	2,798
Interest Income Recognized	2	0
Total Mortgage Loans on Real Estate [Member] | Second Mortgages [Member]
Financing Receivable, Impaired [Line Items]
Unpaid Principal Balance	460	374
Without Valuation Allowance	274	296
With Valuation Allowance	154	47
Associated Allowance	136	3
Average Recorded Investment	462	462
Interest Income Recognized	6	(19)
Total Mortgage Loans on Real Estate [Member] | Equity Line of Credit [Member]
Financing Receivable, Impaired [Line Items]
Unpaid Principal Balance	0	0
Without Valuation Allowance	0	0
With Valuation Allowance	0	0
Associated Allowance	0	0
Average Recorded Investment	0	97
Interest Income Recognized	0	0
Commercial Loans [Member]
Financing Receivable, Impaired [Line Items]
Unpaid Principal Balance	149	150
Without Valuation Allowance	0	149
With Valuation Allowance	149	0
Associated Allowance	149	0
Average Recorded Investment	149	44
Interest Income Recognized	0	6
Consumer Loans [Member]
Financing Receivable, Impaired [Line Items]
Unpaid Principal Balance	15	15
Without Valuation Allowance	15	0
With Valuation Allowance	0	15
Associated Allowance	0	0
Average Recorded Investment	15	17
Interest Income Recognized	0	1
Other [Member]
Financing Receivable, Impaired [Line Items]
Unpaid Principal Balance	0	0
Without Valuation Allowance	0	0
With Valuation Allowance	0	0
Associated Allowance	0	0
Average Recorded Investment	0	0
Interest Income Recognized	$ 0	$ 0