Fair Value of Financial Instruments Level 3 (Details) (Fair Value, Measurements, Recurring [Member], Fair Value, Inputs, Level 3 [Member], USD $) In Thousands, unless otherwise specified	6 Months Ended
	Jun. 30, 2014
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance at the beginning of the period	$ 73,480
Unrealized (loss) gain included in OCI	77
Principal payments	(8,764)
Accretion	449
Balance at the end of the period	65,242
Non-Agency CMBS [Member]
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance at the beginning of the period	70,733
Unrealized (loss) gain included in OCI	200
Principal payments	(8,308)
Accretion	119
Balance at the end of the period	62,744
Non-Agency RMBS [Member]
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance at the beginning of the period	2,747
Unrealized (loss) gain included in OCI	(123)
Principal payments	(456)
Accretion	330
Balance at the end of the period	$ 2,498