Fair Value of Financial Instruments Level 3 (Details) (Fair Value, Measurements, Recurring [Member], Fair Value, Inputs, Level 3 [Member], USD $) In Thousands, unless otherwise specified	3 Months Ended	9 Months Ended
	Sep. 30, 2014	Sep. 30, 2014
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance at the beginning of the period	$ 65,242	$ 73,480
Unrealized (loss) gain included in OCI	863	940
Principal payments	(14,588)	(23,351)
Accretion	57	505
Balance at the end of the period	51,574	51,574
Non-Agency CMBS [Member]
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance at the beginning of the period	62,744	70,733
Unrealized (loss) gain included in OCI	878	1,078
Principal payments	(14,290)	(22,598)
Accretion	57	176
Balance at the end of the period	49,389	49,389
Non-Agency RMBS [Member]
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance at the beginning of the period	2,498	2,747
Unrealized (loss) gain included in OCI	(15)	(138)
Principal payments	(298)	(753)
Accretion	0	329
Balance at the end of the period	$ 2,185	$ 2,185