Loans (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2013	Dec. 31, 2012	Mar. 31, 2012	Dec. 31, 2011
Financing receivables
Total gross loans	$ 954,163	$ 908,579
Unearned fee income	(3,701)	(3,056)
Total loan portfolio	950,462	905,523
Less allowance for credit losses	(20,543)	(19,948)	(19,304)	(18,540)
Loans, net	929,919	885,575
Commercial
Financing receivables
Total gross loans	471,200	436,293
Less allowance for credit losses	(7,582)	(6,394)	(5,922)	(5,545)
Real estate construction
Financing receivables
Total gross loans	37,975	35,501
Less allowance for credit losses	(721)	(673)	(1,587)	(1,220)
Land loans
Financing receivables
Total gross loans	10,353	8,973
Less allowance for credit losses	(320)	(333)	(508)	(613)
Real estate other
Financing receivables
Total gross loans	136,244	139,931
Less allowance for credit losses	(4,321)	(5,178)	(6,162)	(6,111)
Factoring and asset based
Financing receivables
Total gross loans	200,831	195,343
Less allowance for credit losses	(4,731)	(4,352)	(2,735)	(2,381)
SBA
Financing receivables
Total gross loans	91,893	87,375
Less allowance for credit losses	(2,743)	(2,905)	(2,300)	(2,567)
Other
Financing receivables
Total gross loans	5,667	5,163
Less allowance for credit losses	$ (125)	$ (113)	$ (90)	$ (103)