Investment Securities (Schedule of Preferred Security and Associated Ratings) (Details) (USD $) In Thousands, unless otherwise specified	6 Months Ended		12 Months Ended
	Jun. 30, 2013		Dec. 31, 2012
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	$ 417,470		$ 482,440
Available-for-sale Securities, Gross Unrealized Gain (Loss)	8,036		16,316
Available-for-sale Securities, Fair Value	419,773		496,815
Countrywide Capital IV [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	1,770
Available-for-sale Securities, Gross Unrealized Gain (Loss)	2
Available-for-sale Securities, Fair Value	1,772
Number of banks currently performing	1
Countrywide Capital IV [Member] | Standard & Poor's, BB+ Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB+
Countrywide Capital V [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	2,747
Available-for-sale Securities, Gross Unrealized Gain (Loss)	21
Available-for-sale Securities, Fair Value	2,768
Number of banks currently performing	1
Countrywide Capital V [Member] | Standard & Poor's, BB+ Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB+
Countrywide Capital V [Member] | Additional Deal Value [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	250
Available-for-sale Securities, Gross Unrealized Gain (Loss)	2
Available-for-sale Securities, Fair Value	252
Number of banks currently performing	1
Countrywide Capital V [Member] | Additional Deal Value [Member] | Standard & Poor's, BB+ Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB+
Citigroup Cap IX [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	992
Available-for-sale Securities, Gross Unrealized Gain (Loss)	9
Available-for-sale Securities, Fair Value	1,001
Number of banks currently performing	1
Citigroup Cap IX [Member] | Standard & Poor's, BB Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB
Citigroup Cap IX [Member] | Additional Deal Value [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	1,906
Available-for-sale Securities, Gross Unrealized Gain (Loss)	25
Available-for-sale Securities, Fair Value	1,931
Number of banks currently performing	1
Citigroup Cap IX [Member] | Additional Deal Value [Member] | Standard & Poor's, BB Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB
Citigroup Cap XI [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	246
Available-for-sale Securities, Gross Unrealized Gain (Loss)	3
Available-for-sale Securities, Fair Value	249
Number of banks currently performing	1
Citigroup Cap XI [Member] | Standard & Poor's, BB Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB
Nationsbank Cap Trust III [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	1,573
Available-for-sale Securities, Gross Unrealized Gain (Loss)	(313)
Available-for-sale Securities, Fair Value	1,260
Number of banks currently performing	1
Nationsbank Cap Trust III [Member] | Standard & Poor's, BB+ Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB+
Morgan Stanley Cap Trust IV [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	2,500
Available-for-sale Securities, Gross Unrealized Gain (Loss)	(10)
Available-for-sale Securities, Fair Value	2,490
Number of banks currently performing	1
Morgan Stanley Cap Trust IV [Member] | Standard & Poor's, BB+ Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB+
Morgan Stanley Cap Trust IV [Member] | Additional Deal Value [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	1,742
Available-for-sale Securities, Gross Unrealized Gain (Loss)	0
Available-for-sale Securities, Fair Value	1,742
Number of banks currently performing	1
Morgan Stanley Cap Trust IV [Member] | Additional Deal Value [Member] | Standard & Poor's, BB+ Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB+
Saturns - GS 2004-04 [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	535
Available-for-sale Securities, Gross Unrealized Gain (Loss)	11
Available-for-sale Securities, Fair Value	546
Number of banks currently performing	1
Saturns - GS 2004-04 [Member] | Standard & Poor's, BB+ Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB+
Goldman Sachs [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	1,000
Available-for-sale Securities, Gross Unrealized Gain (Loss)	(47)
Available-for-sale Securities, Fair Value	953
Number of banks currently performing	1
Goldman Sachs [Member] | Standard & Poor's, BB+ Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	BB+
Stifel Financial [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	4,500
Available-for-sale Securities, Gross Unrealized Gain (Loss)	151
Available-for-sale Securities, Fair Value	4,651
Debt Instrument, Credit Rating	BBB-
Number of banks currently performing	1
ALESCO Preferred Funding VII [Member]
Schedule of Investments [Line Items]
Available-for-sale Securities, Amortized Cost Basis	859
Available-for-sale Securities, Gross Unrealized Gain (Loss)	(787)
Available-for-sale Securities, Fair Value	$ 72
Deferral and Defaults as a percentage of collateral	35.90%
Expected deferral default as a percent of remaining performing colleteral	34.50%
ALESCO Preferred Funding VII [Member] | Ca Rating [Member]
Schedule of Investments [Line Items]
Debt Instrument, Credit Rating	Ca
ALESCO Preferred Funding VII [Member] | Maximum [Member]
Schedule of Investments [Line Items]
Number of banks currently performing	61	[1]
ALESCO Preferred Funding VII [Member] | Minimum [Member]
Schedule of Investments [Line Items]
Number of banks currently performing	47	[1]

[1] Includes banks and insurance companies.