Credit Quality of Loans and Allowance for Loan Losses - Age Analysis of Past Due Loans (Details) - USD ($) $ in Thousands	Jun. 30, 2015	Dec. 31, 2014
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	$ 17,472	$ 10,267
60-89 Days Past Due	1,695	1,858
Greater than 90 Days Past Due	10,211	5,954
Total Past Due	29,378	18,079
Current	1,265,014	1,266,352
Total Loans	1,294,392	1,284,431
Recorded Investment, 90 days past due and Accruing	609	187
Commercial, financial and agricultural
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	1,710	2,179
60-89 Days Past Due	592	654
Greater than 90 Days Past Due	2,999	2,556
Total Past Due	5,301	5,389
Current	466,096	461,758
Total Loans	471,397	467,147
Recorded Investment, 90 days past due and Accruing	501	26
Commercial real estate - construction
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	364	15
60-89 Days Past Due	0	0
Greater than 90 Days Past Due	13	105
Total Past Due	377	120
Current	57,151	43,390
Total Loans	57,528	43,510
Recorded Investment, 90 days past due and Accruing	0	97
Commercial real estate - other
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	13,681	4,989
60-89 Days Past Due	361	270
Greater than 90 Days Past Due	4,994	2,464
Total Past Due	19,036	7,723
Current	449,986	459,449
Total Loans	469,022	467,172
Recorded Investment, 90 days past due and Accruing	0	0
Residential - construction
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	0	431
60-89 Days Past Due	0	0
Greater than 90 Days Past Due	490	0
Total Past Due	490	431
Current	21,158	24,636
Total Loans	21,648	25,067
Recorded Investment, 90 days past due and Accruing	0	0
Residential - prime
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	523	1,843
60-89 Days Past Due	449	523
Greater than 90 Days Past Due	1,378	704
Total Past Due	2,350	3,070
Current	151,470	151,532
Total Loans	153,820	154,602
Recorded Investment, 90 days past due and Accruing	0	0
Consumer - credit card
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	29	5
60-89 Days Past Due	29	19
Greater than 90 Days Past Due	13	18
Total Past Due	71	42
Current	5,749	5,970
Total Loans	5,820	6,012
Recorded Investment, 90 days past due and Accruing	13	18
Consumer - other
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	1,065	671
60-89 Days Past Due	264	392
Greater than 90 Days Past Due	324	107
Total Past Due	1,653	1,170
Current	106,153	112,146
Total Loans	107,806	113,316
Recorded Investment, 90 days past due and Accruing	95	46
Lease financing receivable
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	0	0
60-89 Days Past Due	0	0
Greater than 90 Days Past Due	0	0
Total Past Due	0	0
Current	5,561	4,857
Total Loans	5,561	4,857
Recorded Investment, 90 days past due and Accruing	0	0
Other loans
Age Analysis of Past Due Loans by Class of Loans [Abstract]
30-59 Days Past Due	100	134
60-89 Days Past Due	0	0
Greater than 90 Days Past Due	0	0
Total Past Due	100	134
Current	1,690	2,614
Total Loans	1,790	2,748
Recorded Investment, 90 days past due and Accruing	$ 0	$ 0