Loans (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended
	Mar. 31, 2014	Mar. 31, 2013	Dec. 31, 2013
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	$ 32,325	$ 44,275
Additions (deductions) [Abstract]
Provision for loan losses	428	(691)
Recoveries credited to allowance	1,068	1,451
Loans charged against the allowance	(3,384)	(4,270)
Balance at end of period	30,437	40,765
Allowance for loan losses [Abstract]
Individually evaluated for impairment	14,986		15,158
Collectively evaluated for impairment	15,451		17,167
Total ending allowance balance	30,437		32,325
Loans [Abstract]
Individually evaluated for impairment	124,299		125,713
Collectively evaluated for impairment	1,240,531		1,253,436
Total loans recorded investment	1,364,830		1,379,149
Accrued interest included in recorded investment	4,318		4,579
Total Loans	1,360,512		1,374,570
Commercial [Member]
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	6,827	11,402
Additions (deductions) [Abstract]
Provision for loan losses	507	(272)
Recoveries credited to allowance	355	536
Loans charged against the allowance	(1,926)	(1,608)
Balance at end of period	5,763	10,058
Allowance for loan losses [Abstract]
Individually evaluated for impairment	3,289		3,878
Collectively evaluated for impairment	2,474		2,949
Total ending allowance balance	5,763		6,827
Loans [Abstract]
Individually evaluated for impairment	40,014		40,623
Collectively evaluated for impairment	603,533		596,235
Total loans recorded investment	643,547		636,858
Accrued interest included in recorded investment	1,496		1,624
Total Loans	642,051		635,234
Mortgage [Member]
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	17,195	21,447
Additions (deductions) [Abstract]
Provision for loan losses	193	(139)
Recoveries credited to allowance	458	622
Loans charged against the allowance	(846)	(1,767)
Balance at end of period	17,000	20,163
Allowance for loan losses [Abstract]
Individually evaluated for impairment	10,912		10,488
Collectively evaluated for impairment	6,088		6,707
Total ending allowance balance	17,000		17,195
Loans [Abstract]
Individually evaluated for impairment	77,159		78,022
Collectively evaluated for impairment	400,598		410,887
Total loans recorded investment	477,757		488,909
Accrued interest included in recorded investment	2,177		2,276
Total Loans	475,580		486,633
Installment [Member]
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	2,246	3,378
Additions (deductions) [Abstract]
Provision for loan losses	176	375
Recoveries credited to allowance	251	286
Loans charged against the allowance	(612)	(877)
Balance at end of period	2,061	3,162
Allowance for loan losses [Abstract]
Individually evaluated for impairment	785		792
Collectively evaluated for impairment	1,276		1,454
Total ending allowance balance	2,061		2,246
Loans [Abstract]
Individually evaluated for impairment	7,126		7,068
Collectively evaluated for impairment	181,856		185,676
Total loans recorded investment	188,982		192,744
Accrued interest included in recorded investment	645		679
Total Loans	188,337		192,065
Payment Plan Receivable [Member]
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	97	144
Additions (deductions) [Abstract]
Provision for loan losses	(14)	(4)
Recoveries credited to allowance	4	7
Loans charged against the allowance	0	(18)
Balance at end of period	87	129
Allowance for loan losses [Abstract]
Individually evaluated for impairment	0		0
Collectively evaluated for impairment	87		97
Total ending allowance balance	87		97
Loans [Abstract]
Individually evaluated for impairment	0		0
Collectively evaluated for impairment	54,544		60,638
Total loans recorded investment	54,544		60,638
Accrued interest included in recorded investment	0		0
Total Loans	54,544		60,638
Unallocated [Member]
Analysis of allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period	5,960	7,904
Additions (deductions) [Abstract]
Provision for loan losses	(434)	(651)
Recoveries credited to allowance	0	0
Loans charged against the allowance	0	0
Balance at end of period	5,526	7,253
Allowance for loan losses [Abstract]
Individually evaluated for impairment	0		0
Collectively evaluated for impairment	5,526		5,960
Total ending allowance balance	$ 5,526		$ 5,960