Fair Value of Financial Instruments Fair Value on a Recurring Basis (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	$ 4,018,161	$ 4,103,981
Derivative assets	18,488	0
Derivative Liabilities	6,681	42,537
Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value, Fair Value Disclosure [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	4,018,161	4,103,981
Other Investments, Fair Value Disclosure		25
Derivative assets	18,488
Total assets carried at fair value	4,036,649	4,104,006
Derivative Liabilities	6,681	42,537
Total liabilities carried at fair value	6,681	42,537
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	0	0
Other Investments, Fair Value Disclosure		0
Derivative assets	0
Total assets carried at fair value	0	0
Derivative Liabilities	5,345	0
Total liabilities carried at fair value	5,345	0
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	3,944,681	3,998,761
Other Investments, Fair Value Disclosure		0
Derivative assets	18,488
Total assets carried at fair value	3,963,169	3,998,761
Derivative Liabilities	1,336	42,537
Total liabilities carried at fair value	1,336	42,537
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	73,480	105,220
Other Investments, Fair Value Disclosure		25
Derivative assets	0
Total assets carried at fair value	73,480	105,245
Derivative Liabilities	0	0
Total liabilities carried at fair value	$ 0	$ 0