Credit Quality of Loans and Allowance for Loan Losses - Age Analysis of Past Due Loans (Details) - USD ($) $ in Thousands	Sep. 30, 2015	Dec. 31, 2014
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	$ 14,207	$ 10,267
60-89 Days Past Due	6,405	1,858
Greater than 90 Days Past Due	22,796	5,954
Total Past Due	43,408	18,079
Current	1,258,044	1,266,352
Total Loans	1,301,452	1,284,431
Recorded Investment, 90 days past due and Accruing	82	187
Commercial, financial and agricultural
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	4,065	2,179
60-89 Days Past Due	3,124	654
Greater than 90 Days Past Due	3,879	2,556
Total Past Due	11,068	5,389
Current	471,384	461,758
Total Loans	482,452	467,147
Recorded Investment, 90 days past due and Accruing	23	26
Commercial real estate - construction
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	93	15
60-89 Days Past Due	99	0
Greater than 90 Days Past Due	12	105
Total Past Due	204	120
Current	55,484	43,390
Total Loans	55,688	43,510
Recorded Investment, 90 days past due and Accruing	0	97
Commercial real estate - other
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	7,252	4,989
60-89 Days Past Due	2,745	270
Greater than 90 Days Past Due	16,999	2,464
Total Past Due	26,996	7,723
Current	446,323	459,449
Total Loans	473,319	467,172
Recorded Investment, 90 days past due and Accruing	0	0
Residential - construction
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	0	431
60-89 Days Past Due	0	0
Greater than 90 Days Past Due	172	0
Total Past Due	172	431
Current	18,419	24,636
Total Loans	18,591	25,067
Recorded Investment, 90 days past due and Accruing	0	0
Residential - prime
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	1,383	1,843
60-89 Days Past Due	264	523
Greater than 90 Days Past Due	1,378	704
Total Past Due	3,025	3,070
Current	148,642	151,532
Total Loans	151,667	154,602
Recorded Investment, 90 days past due and Accruing	0	0
Consumer - credit card
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	38	5
60-89 Days Past Due	11	19
Greater than 90 Days Past Due	27	18
Total Past Due	76	42
Current	5,683	5,970
Total Loans	5,759	6,012
Recorded Investment, 90 days past due and Accruing	27	18
Consumer - other
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	1,228	671
60-89 Days Past Due	162	392
Greater than 90 Days Past Due	329	107
Total Past Due	1,719	1,170
Current	105,721	112,146
Total Loans	107,440	113,316
Recorded Investment, 90 days past due and Accruing	32	46
Lease financing receivable
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	0	0
60-89 Days Past Due	0	0
Greater than 90 Days Past Due	0	0
Total Past Due	0	0
Current	4,790	4,857
Total Loans	4,790	4,857
Recorded Investment, 90 days past due and Accruing	0	0
Other loans
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	148	134
60-89 Days Past Due	0	0
Greater than 90 Days Past Due	0	0
Total Past Due	148	134
Current	1,598	2,614
Total Loans	1,746	2,748
Recorded Investment, 90 days past due and Accruing	$ 0	$ 0