Allowance for Loan Losses ("ALLL") (Details) (USD $)	3 Months Ended			9 Months Ended
	Sep. 30, 2013	Sep. 30, 2012	Jun. 30, 2012	Sep. 30, 2013	Sep. 30, 2012	Dec. 31, 2012
Allocation of the allowance to various segments in the loan portfolio
Balance, at the beginning of the period	$ 17,934,000	$ 18,149,000		$ 18,118,000	$ 19,314,000
Charge-offs	(984,000)	(1,718,000)		(1,851,000)	(9,745,000)
Recoveries	518,000	270,000		1,201,000	737,000
Provisions for loan losses		1,286,000			7,681,000
Balance, at the end of the period	17,468,000	17,987,000	18,149,000	17,468,000	17,987,000
Amount of allowance attributed to:
Specifically evaluated impaired loans	6,825,000			6,825,000		6,061,000
General portfolio allocation	10,643,000			10,643,000		12,057,000
Loans individually evaluated for impairment	15,555,000			15,555,000		17,341,000
Loans collectively evaluated for impairment	761,599,000			761,599,000		672,267,000
General reserves to total loans collectively evaluated for impairment (as a percent)	1.40%			1.40%		1.79%
Total gross loans	777,154,000			777,154,000		689,608,000
Total allowance to gross loans (as a percent)	2.25%			2.25%		2.63%
Provision for loan losses, transfer from C&I to Land related to the re-characterization of a loan as part of a TDR			3,900,000
Real Estate Secured
Allocation of the allowance to various segments in the loan portfolio
Balance, at the beginning of the period	6,509,000	6,897,000		6,879,000	9,645,000
Charge-offs	(41,000)	(106,000)		(131,000)	(2,471,000)
Recoveries	19,000	12,000		143,000	74,000
Provisions for loan losses	(180,000)	1,184,000		(584,000)	739,000
Balance, at the end of the period	6,307,000	7,987,000		6,307,000	7,987,000
Amount of allowance attributed to:
Specifically evaluated impaired loans	108,000			108,000		25,000
General portfolio allocation	6,199,000			6,199,000		6,854,000
Loans individually evaluated for impairment	2,003,000			2,003,000		2,898,000
Loans collectively evaluated for impairment	601,078,000			601,078,000		490,110,000
General reserves to total loans collectively evaluated for impairment (as a percent)	1.03%			1.03%		1.40%
Total gross loans	603,081,000			603,081,000		493,008,000
Total allowance to gross loans (as a percent)	1.05%			1.05%		1.40%
Commercial
Allocation of the allowance to various segments in the loan portfolio
Balance, at the beginning of the period	6,618,000	6,261,000		6,154,000	6,549,000
Charge-offs	(736,000)	(1,511,000)		(1,137,000)	(4,272,000)
Recoveries	475,000	246,000		947,000	623,000
Provisions for loan losses	(207,000)	75,000		186,000	2,171,000
Balance, at the end of the period	6,150,000	5,071,000		6,150,000	5,071,000
Amount of allowance attributed to:
Specifically evaluated impaired loans	2,853,000			2,853,000		2,185,000
General portfolio allocation	3,297,000			3,297,000		3,969,000
Loans individually evaluated for impairment	5,465,000			5,465,000		5,596,000
Loans collectively evaluated for impairment	126,642,000			126,642,000		141,468,000
General reserves to total loans collectively evaluated for impairment (as a percent)	2.60%			2.60%		2.81%
Total gross loans	132,107,000			132,107,000		147,064,000
Total allowance to gross loans (as a percent)	4.66%			4.66%		4.18%
Construction
Allocation of the allowance to various segments in the loan portfolio
Balance, at the beginning of the period	198,000	381,000		313,000	488,000
Charge-offs		(92,000)		(169,000)	(668,000)
Recoveries	1,000	1,000		2,000	1,000
Provisions for loan losses	44,000	268,000		97,000	737,000
Balance, at the end of the period	243,000	558,000		243,000	558,000
Amount of allowance attributed to:
General portfolio allocation	243,000			243,000		313,000
Loans individually evaluated for impairment						1,380,000
Loans collectively evaluated for impairment	13,174,000			13,174,000		18,336,000
General reserves to total loans collectively evaluated for impairment (as a percent)	1.84%			1.84%		1.71%
Total gross loans	13,174,000			13,174,000		19,716,000
Total allowance to gross loans (as a percent)	1.84%			1.84%		1.59%
Land
Allocation of the allowance to various segments in the loan portfolio
Balance, at the beginning of the period	4,465,000	4,483,000		4,670,000	2,416,000
Charge-offs				(34,000)	(2,168,000)
Recoveries	11,000	5,000		45,000	18,000
Provisions for loan losses	170,000	(225,000)		(35,000)	3,997,000
Balance, at the end of the period	4,646,000	4,263,000		4,646,000	4,263,000
Amount of allowance attributed to:
Specifically evaluated impaired loans	3,854,000			3,854,000		3,829,000
General portfolio allocation	792,000			792,000		841,000
Loans individually evaluated for impairment	8,060,000			8,060,000		7,182,000
Loans collectively evaluated for impairment	16,982,000			16,982,000		17,482,000
General reserves to total loans collectively evaluated for impairment (as a percent)	4.66%			4.66%		4.81%
Total gross loans	25,042,000			25,042,000		24,664,000
Total allowance to gross loans (as a percent)	18.55%			18.55%		18.93%
Installment
Allocation of the allowance to various segments in the loan portfolio
Balance, at the beginning of the period	108,000	91,000		64,000	175,000
Charge-offs	(207,000)	(9,000)		(380,000)	(29,000)
Recoveries	12,000	5,000		64,000	18,000
Provisions for loan losses	174,000	(15,000)		339,000	(92,000)
Balance, at the end of the period	87,000	72,000		87,000	72,000
Amount of allowance attributed to:
Specifically evaluated impaired loans	10,000			10,000		22,000
General portfolio allocation	77,000			77,000		42,000
Loans individually evaluated for impairment	27,000			27,000		285,000
Loans collectively evaluated for impairment	3,468,000			3,468,000		4,610,000
General reserves to total loans collectively evaluated for impairment (as a percent)	2.22%			2.22%		0.91%
Total gross loans	3,495,000			3,495,000		4,895,000
Total allowance to gross loans (as a percent)	2.49%			2.49%		1.31%
All Other Loans
Allocation of the allowance to various segments in the loan portfolio
Balance, at the beginning of the period	36,000	36,000		38,000	41,000
Charge-offs					(137,000)
Recoveries		1,000			3,000
Provisions for loan losses	(1,000)	(1,000)		(3,000)	129,000
Balance, at the end of the period	35,000	36,000		35,000	36,000
Amount of allowance attributed to:
General portfolio allocation	35,000			35,000		38,000
Loans collectively evaluated for impairment	255,000			255,000		261,000
General reserves to total loans collectively evaluated for impairment (as a percent)	13.73%			13.73%		14.56%
Total gross loans	$ 255,000			$ 255,000		$ 261,000
Total allowance to gross loans (as a percent)	13.73%			13.73%		14.56%