Investment Securities (Unrealized Gain (Loss) on Investments) (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2013	Dec. 31, 2012
Schedule of Investments [Line Items]
Amortized Cost	$ 202,550	$ 187,667
Gross Unrealized Gains	2,383	4,588
Gross Unrealized Losses	(5,211)	(2,996)
Fair Value	199,722	189,259
Held-to-maturity Securities	69	67
Held-to-maturity Securities, Unrecognized Holding Gains	0	2
Held-to-maturity Securities, Unrecognized Holding Losses	0	0
Fair Value	69	69
Collateralized Mortgage Obligations [Member]
Schedule of Investments [Line Items]
Amortized Cost	122,657	97,959
Gross Unrealized Gains	521	1,830
Gross Unrealized Losses	(2,760)	(6)
Fair Value	120,418	99,783
Mortgage-backed Securities [Member]
Schedule of Investments [Line Items]
Amortized Cost	15,007	20,626
Gross Unrealized Gains	634	1,014
Gross Unrealized Losses	(55)	0
Fair Value	15,586	21,640
Municipal Securities [Member]
Schedule of Investments [Line Items]
Amortized Cost	8,004	11,150
Gross Unrealized Gains	97	967
Gross Unrealized Losses	(99)	(16)
Fair Value	8,002	12,101
Corporate Bonds [Member]
Schedule of Investments [Line Items]
Amortized Cost	32,188	32,231
Gross Unrealized Gains	805	639
Gross Unrealized Losses	0	(185)
Fair Value	32,993	32,685
Asset-backed Securities [Member]
Schedule of Investments [Line Items]
Amortized Cost	19,234	19,785
Gross Unrealized Gains	324	135
Gross Unrealized Losses	0	(191)
Fair Value	19,558	19,729
Trust Preferred Securities [Member]
Schedule of Investments [Line Items]
Amortized Cost	5,345	5,785
Gross Unrealized Gains	0	0
Gross Unrealized Losses	(2,297)	(2,598)
Fair Value	3,048	3,187
U.S. Government Agencies [Member]
Schedule of Investments [Line Items]
Held-to-maturity Securities	1	1
Held-to-maturity Securities, Unrecognized Holding Gains	0	0
Held-to-maturity Securities, Unrecognized Holding Losses	0	0
Fair Value	1	1
Other Securities [Member]
Schedule of Investments [Line Items]
Amortized Cost	115	131
Gross Unrealized Gains	2	3
Gross Unrealized Losses	0	0
Fair Value	117	134
Held-to-maturity Securities	68	66
Held-to-maturity Securities, Unrecognized Holding Gains	0	2
Held-to-maturity Securities, Unrecognized Holding Losses	0	0
Fair Value	$ 68	$ 68