Fair Value Measurement of Financial Instruments (Fair Value, by Balance Sheet Grouping) (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2013	Jun. 30, 2013	Dec. 31, 2012	Sep. 30, 2012	Jun. 30, 2012	Dec. 31, 2011
Financial Assets [Abstract]
Investment securities available for sale	$ 199,722		$ 189,259
Investment securities held to maturity	69		69
SBA servicing assets	3,075	2,904	2,340	1,911	1,630	1,102
Carrying Amount [Member]
Financial Assets [Abstract]
Cash and cash equivalents	44,305		128,004
Investment securities available for sale	199,722		189,259
Investment securities held to maturity	69		67
Restricted stock	1,570		3,816
Loans held for sale	7,130		82
Loans receivable, net	641,533		608,359
SBA servicing assets	3,075		2,340
Accrued interest receivable	2,920		3,128
Financial Liabilities [Abstract]
Demand, savings and money market	761,926		765,967
Time	83,577		123,234
Subordinated debt	22,476		22,476
Accrued interest payable	309		301
Off Balance Sheet Data [Abstract]
Commitments to extend credit	0		0
Standby letters of credit	0		0
Fair Value [Member]
Financial Assets [Abstract]
Cash and cash equivalents	44,305		128,004
Investment securities available for sale	199,722		189,259
Investment securities held to maturity	69		69
Restricted stock	1,570		3,816
Loans held for sale	7,728		82
Loans receivable, net	634,657		603,237
SBA servicing assets	3,075		2,340
Accrued interest receivable	2,920		3,128
Financial Liabilities [Abstract]
Demand, savings and money market	761,926		765,967
Time	84,036		124,044
Subordinated debt	17,960		20,187
Accrued interest payable	309		301
Off Balance Sheet Data [Abstract]
Commitments to extend credit	0		0
Standby letters of credit	0		0
Fair Value, Inputs, Level 1 [Member]
Financial Assets [Abstract]
Cash and cash equivalents	44,305		128,004
Investment securities available for sale	0		0
Investment securities held to maturity	0		0
Restricted stock	0		0
Loans held for sale	0		0
Loans receivable, net	0		0
SBA servicing assets	0		0
Accrued interest receivable	0		0
Financial Liabilities [Abstract]
Demand, savings and money market	0		0
Time	0		0
Subordinated debt	0		0
Accrued interest payable	0		0
Significant Other Observable Inputs [Member]
Financial Assets [Abstract]
Cash and cash equivalents	0		0
Investment securities available for sale	193,668		183,065
Investment securities held to maturity	69		69
Restricted stock	1,570		3,816
Loans held for sale	0		0
Loans receivable, net	0		0
SBA servicing assets	0		0
Accrued interest receivable	2,920		3,128
Financial Liabilities [Abstract]
Demand, savings and money market	761,926		765,967
Time	84,036		124,044
Subordinated debt	0		0
Accrued interest payable	309		301
Significant Unobservable Inputs [Member]
Financial Assets [Abstract]
Cash and cash equivalents	0		0
Investment securities available for sale	6,054		6,194
Investment securities held to maturity	0		0
Restricted stock	0		0
Loans held for sale	7,728		82
Loans receivable, net	634,657		603,237
SBA servicing assets	3,075		2,340
Accrued interest receivable	0		0
Financial Liabilities [Abstract]
Demand, savings and money market	0		0
Time	0		0
Subordinated debt	17,960		20,187
Accrued interest payable	$ 0		$ 0