Investment Securities (Unrealized Gain (Loss) on Investments) (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013
Schedule of Investments [Line Items]
Amortized Cost	$ 159,039	$ 209,303
Gross Unrealized Gains	2,316	2,755
Gross Unrealized Losses	(2,525)	(7,167)
Fair Value	158,830	204,891
Held to Maturity: Amortized Cost: Total	68,991	21
Held-to-maturity Securities, Unrecognized Holding Gains	123	0
Held-to-maturity Securities, Unrecognized Holding Losses	(468)	0
Fair Value	68,646	21
Collateralized Mortgage Obligations [Member]
Schedule of Investments [Line Items]
Amortized Cost	83,145	127,242
Gross Unrealized Gains	326	665
Gross Unrealized Losses	(346)	(4,467)
Fair Value	83,125	123,440
Held to Maturity: Amortized Cost: Total	68,970
Held-to-maturity Securities, Unrecognized Holding Gains	123
Held-to-maturity Securities, Unrecognized Holding Losses	(468)
Fair Value	68,625
Mortgage-backed Securities [Member]
Schedule of Investments [Line Items]
Amortized Cost	12,832	15,669
Gross Unrealized Gains	611	623
Gross Unrealized Losses	(56)	(111)
Fair Value	13,387	16,181
Municipal Securities [Member]
Schedule of Investments [Line Items]
Amortized Cost	12,246	9,737
Gross Unrealized Gains	348	68
Gross Unrealized Losses	(41)	(162)
Fair Value	12,553	9,643
Corporate Bonds [Member]
Schedule of Investments [Line Items]
Amortized Cost	26,908	32,174
Gross Unrealized Gains	818	1,079
Gross Unrealized Losses	0	0
Fair Value	27,726	33,253
Asset-backed Securities [Member]
Schedule of Investments [Line Items]
Amortized Cost	18,532	19,089
Gross Unrealized Gains	204	318
Gross Unrealized Losses	0	0
Fair Value	18,736	19,407
Trust Preferred Securities [Member]
Schedule of Investments [Line Items]
Amortized Cost	5,261	5,277
Gross Unrealized Gains	0	0
Gross Unrealized Losses	(2,082)	(2,427)
Fair Value	3,179	2,850
U.S. Government Agencies [Member]
Schedule of Investments [Line Items]
Held to Maturity: Amortized Cost: Total	1	1
Held-to-maturity Securities, Unrecognized Holding Gains	0	0
Held-to-maturity Securities, Unrecognized Holding Losses	0	0
Fair Value	1	1
Other Securities [Member]
Schedule of Investments [Line Items]
Amortized Cost	115	115
Gross Unrealized Gains	9	2
Gross Unrealized Losses	0	0
Fair Value	124	117
Held to Maturity: Amortized Cost: Total	20	20
Held-to-maturity Securities, Unrecognized Holding Gains	0	0
Held-to-maturity Securities, Unrecognized Holding Losses	0	0
Fair Value	$ 20	$ 20