Fair Value of Financial Instruments Level 3 (Details) (Fair Value, Measurements, Recurring [Member], Fair Value, Inputs, Level 3 [Member], USD $) In Thousands, unless otherwise specified	3 Months Ended
	Mar. 31, 2014
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance at the beginning of the period	$ 73,480
Unrealized (loss) gain included in OCI	(99)
Principal payments	(7,388)
Amortization	394
Balance at the end of the period	66,387
Non-Agency CMBS [Member]
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance at the beginning of the period	70,733
Unrealized (loss) gain included in OCI	27
Principal payments	(6,993)
Amortization	65
Balance at the end of the period	63,832
Non-Agency RMBS [Member]
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation, Calculation [Roll Forward]
Balance at the beginning of the period	2,747
Unrealized (loss) gain included in OCI	(126)
Principal payments	(395)
Amortization	329
Balance at the end of the period	$ 2,555