Loans - Past Due Status (Details) - USD ($)	Mar. 31, 2017	Dec. 31, 2016
Loans on nonaccrual status
Total Past Due	$ 14,307,000	$ 23,155,000
Current	979,111,000	964,817,000
Total Loans	1,000,827,000	997,228,000
90+ days past due and accruing	1,406,000	6,000
Additional disclosure for nonaccrual loans
Current, nonaccrual status	6,300,000	3,040,000
Nonaccrual loans, 30-59 days past due	379,000	570,000
Nonaccrual loans, 60-89 days past due	1,940,000	370,000
Nonaccrual loans, 90+ days past due	510,000	867,000
PCI
Loans on nonaccrual status
PCI	7,409,000	9,256,000
30-59 Days Past Due
Loans on nonaccrual status
Total Past Due	9,599,000	19,930,000
60-89 Days Past Due
Loans on nonaccrual status
Total Past Due	2,791,000	2,358,000
90+ Days Past Due
Loans on nonaccrual status
Total Past Due	1,917,000	867,000
Real estate - residential mortgage
Loans on nonaccrual status
Total Past Due	1,693,000	1,265,000
Current	186,869,000	185,780,000
Total Loans	189,769,000	188,264,000
90+ days past due and accruing	194,000
Real estate - residential mortgage | PCI
Loans on nonaccrual status
PCI	1,207,000	1,219,000
Real estate - residential mortgage | 30-59 Days Past Due
Loans on nonaccrual status
Total Past Due	1,279,000	848,000
Real estate - residential mortgage | 60-89 Days Past Due
Loans on nonaccrual status
Total Past Due	95,000	233,000
Real estate - residential mortgage | 90+ Days Past Due
Loans on nonaccrual status
Total Past Due	319,000	184,000
Equity lines
Loans on nonaccrual status
Total Past Due	564,000	991,000
Current	50,303,000	51,331,000
Total Loans	51,147,000	52,600,000
90+ days past due and accruing	120,000
Equity lines | PCI
Loans on nonaccrual status
PCI	280,000	278,000
Equity lines | 30-59 Days Past Due
Loans on nonaccrual status
Total Past Due	444,000	853,000
Equity lines | 60-89 Days Past Due
Loans on nonaccrual status
Total Past Due		138,000
Equity lines | 90+ Days Past Due
Loans on nonaccrual status
Total Past Due	120,000
Consumer Loan
Loans on nonaccrual status
Total Past Due	24,000	140,000
Current	10,980,000	8,259,000
Total Loans	11,004,000	8,399,000
90+ days past due and accruing		6,000
Consumer Loan | 30-59 Days Past Due
Loans on nonaccrual status
Total Past Due	22,000	22,000
Consumer Loan | 90+ Days Past Due
Loans on nonaccrual status
Total Past Due	2,000	118,000
Consumer Finance
Loans on nonaccrual status
Total Past Due	8,938,000	15,551,000
Current	289,423,000	286,294,000
Total Loans	298,361,000	301,845,000
Consumer Finance | 30-59 Days Past Due
Loans on nonaccrual status
Total Past Due	7,774,000	13,011,000
Consumer Finance | 60-89 Days Past Due
Loans on nonaccrual status
Total Past Due	780,000	1,975,000
Consumer Finance | 90+ Days Past Due
Loans on nonaccrual status
Total Past Due	384,000	565,000
Construction Lending | Real estate - construction
Loans on nonaccrual status
Current	42,390,000	47,062,000
Total Loans	42,390,000	47,062,000
Consumer lot lending | Real estate - construction
Loans on nonaccrual status
Current	8,303,000	8,670,000
Total Loans	8,303,000	8,670,000
Commercial real estate lending | Commercial, financial and agricultural
Loans on nonaccrual status
Total Past Due	2,436,000	5,133,000
Current	268,165,000	249,408,000
Total Loans	276,523,000	261,786,000
90+ days past due and accruing	455,000
Commercial real estate lending | Commercial, financial and agricultural | PCI
Loans on nonaccrual status
PCI	5,922,000	7,245,000
Commercial real estate lending | Commercial, financial and agricultural | 30-59 Days Past Due
Loans on nonaccrual status
Total Past Due	65,000	5,121,000
Commercial real estate lending | Commercial, financial and agricultural | 60-89 Days Past Due
Loans on nonaccrual status
Total Past Due	1,916,000	12,000
Commercial real estate lending | Commercial, financial and agricultural | 90+ Days Past Due
Loans on nonaccrual status
Total Past Due	455,000
Land acquisition and development lending | Commercial, financial and agricultural
Loans on nonaccrual status
Total Past Due	270,000
Current	38,172,000	43,472,000
Total Loans	38,442,000	43,472,000
90+ days past due and accruing	270,000
Land acquisition and development lending | Commercial, financial and agricultural | 90+ Days Past Due
Loans on nonaccrual status
Total Past Due	270,000
Builder line lending | Commercial, financial and agricultural
Loans on nonaccrual status
Total Past Due	367,000
Current	25,749,000	22,391,000
Total Loans	26,116,000	22,391,000
90+ days past due and accruing	367,000
Builder line lending | Commercial, financial and agricultural | 90+ Days Past Due
Loans on nonaccrual status
Total Past Due	367,000
Commercial business lending | Commercial, financial and agricultural
Loans on nonaccrual status
Total Past Due	15,000	75,000
Current	58,757,000	62,150,000
Total Loans	58,772,000	62,739,000
Commercial business lending | Commercial, financial and agricultural | PCI
Loans on nonaccrual status
PCI		514,000
Commercial business lending | Commercial, financial and agricultural | 30-59 Days Past Due
Loans on nonaccrual status
Total Past Due	15,000	75,000
CVBK | 1-29 Days Past Due
Loans on nonaccrual status
Total Past Due	48,740,000	52,640,000
CVBK | 30-59 Days Past Due
Loans on nonaccrual status
Total Past Due	389,000	532,000
CVBK | 60-89 Days Past Due
Loans on nonaccrual status
Total Past Due	1,890,000	143,000
CVBK | 90+ Days Past Due
Loans on nonaccrual status
Total Past Due		$ 17,000
PCI Loans
Loans on nonaccrual status
90+ days past due and accruing	$ 194,000