Loans (Details 2) (USD $) In Thousands, unless otherwise specified	3 Months Ended
	Mar. 31, 2013	Dec. 31, 2012
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	$ 954,163	$ 908,579
Commercial
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	471,200	436,293
Real estate construction
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	37,975	35,501
Land loans
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	10,353	8,973
Real estate other
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	136,244	139,931
Factoring and asset based
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	200,831	195,343
SBA
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	91,893	87,375
Other
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	5,667	5,163
Pass
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	893,407	855,485
Pass | Commercial
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	450,683	429,754
Pass | Real estate construction
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	37,975	35,501
Pass | Land loans
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	10,317	8,722
Pass | Real estate other
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	105,924	106,519
Pass | Factoring and asset based
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	197,496	192,798
Pass | SBA
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	85,345	77,028
Pass | Other
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	5,667	5,163
Special Mention
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	17,266	7,527
Special Mention | Commercial
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	15,173	4,877
Special Mention | Real estate other
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans		1,410
Special Mention | Factoring and asset based
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	1,817	803
Special Mention | SBA
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	276	437
Substandard
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	33,902	35,600
Substandard | Commercial
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	4,895	986
Substandard | Land loans
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	27	240
Substandard | Real estate other
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	24,632	26,219
Substandard | Factoring and asset based
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans		292
Substandard | SBA
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	4,348	7,863
Substandard (Nonaccrual)
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Minimum period past due for the loans to be placed on nonaccrual status	90 days
Total gross loans	9,588	9,967
Substandard (Nonaccrual) | Commercial
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	449	676
Substandard (Nonaccrual) | Land loans
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	9	11
Substandard (Nonaccrual) | Real estate other
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	5,688	5,783
Substandard (Nonaccrual) | Factoring and asset based
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	1,518	1,450
Substandard (Nonaccrual) | SBA
Credit quality of the loan portfolio, based upon internally assigned risk ratings
Total gross loans	$ 1,924	$ 2,047