Derivative Instruments and Hedging Activities - Fair Value of Derivative Instruments Not Designated as Hedging Instruments (Details) - USD ($) $ in Thousands		Jun. 30, 2016	Dec. 31, 2015
TBA securities
Derivative [Line Items]
Derivatives Not Designated As Hedging Instruments - Assets		$ 290,318	$ 226,929
Options on U.S. Treasury futures
Derivative [Line Items]
Derivatives Not Designated As Hedging Instruments - Assets		27	15
Interest rate swap futures
Derivative [Line Items]
Derivatives Not Designated As Hedging Instruments - Assets		0	706
Derivatives Not Designated As Hedging Instruments - Liabilities		759	0
Swaptions
Derivative [Line Items]
Derivatives Not Designated As Hedging Instruments - Assets		333	821
Eurodollar futures
Derivative [Line Items]
Derivatives Not Designated As Hedging Instruments - Liabilities		4,572	1,242
U.S. Treasury futures
Derivative [Line Items]
Derivatives Not Designated As Hedging Instruments - Assets		1,002	0
Interest rate swaps
Derivative [Line Items]
Derivatives Not Designated As Hedging Instruments - Liabilities	[1]	284	$ 258
Not Designated as Hedging Instrument | Interest rate swaps
Derivative [Line Items]
Derivative liabilities	[1]	500
Derivative assets		$ 200

[1] Includes interest rate swaps in our Agency IO portfolio. Contracts in a liability position of $0.5 million have been netted against the asset position of $0.2 million in the accompanying condensed consolidated balance sheets at June 30, 2016. There was no netting of interest rate swaps at December 31, 2015.