Impaired Loans and Allowance for Loan Losses - Activity in Allowance for Loan Losses (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Allowance for Loan Losses:
Beginning Balance	$ 17,071	$ 20,068	$ 22,104
Provision for Loan Losses	2,644	(3,486)	3,188
Charge-Offs	(3,599)	(2,755)	(6,784)
Recoveries	3,012	3,244	1,560
Net (Charge-Offs) Recoveries	(587)	489	(5,224)
Ending Balance	19,128	17,071	20,068
Construction and Land Development [Member]
Allowance for Loan Losses:
Beginning Balance	722	808	1,134
Provision for Loan Losses	1,296	139	66
Charge-Offs	(1,271)	(640)	(604)
Recoveries	404	415	212
Net (Charge-Offs) Recoveries	(867)	(225)	(392)
Ending Balance	1,151	722	808
Commercial Real Estate [Member]
Allowance for Loan Losses:
Beginning Balance	4,528	6,160	8,849
Provision for Loan Losses	2,010	(2,917)	(522)
Charge-Offs	(482)	(398)	(2,714)
Recoveries	700	1,683	547
Net (Charge-Offs) Recoveries	218	1,285	(2,167)
Ending Balance	6,756	4,528	6,160
Residential Real Estate [Member]
Allowance for Loan Losses:
Beginning Balance	9,784	11,659	11,090
Provision for Loan Losses	(2,208)	(1,651)	3,273
Charge-Offs	(779)	(1,126)	(3,153)
Recoveries	1,260	902	449
Net (Charge-Offs) Recoveries	481	(224)	(2,704)
Ending Balance	8,057	9,784	11,659
Commercial And Financial [Member]
Allowance for Loan Losses:
Beginning Balance	1,179	710	468
Provision for Loan Losses	1,058	697	(24)
Charge-Offs	(726)	(398)	(60)
Recoveries	531	170	326
Net (Charge-Offs) Recoveries	(195)	(228)	266
Ending Balance	2,042	1,179	710
Consumer [Member]
Allowance for Loan Losses:
Beginning Balance	794	731	563
Provision for Loan Losses	552	182	395
Charge-Offs	(341)	(193)	(253)
Recoveries	117	74	26
Net (Charge-Offs) Recoveries	(224)	(119)	(227)
Ending Balance	$ 1,122	$ 794	$ 731