Fair Value of Financial Instruments Fair Value on a Recurring Basis (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2013	Dec. 31, 2012
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	$ 4,267,917	$ 4,103,981
Derivative Liabilities	37,687	42,537
Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value, Fair Value Disclosure [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total assets carried at fair value	4,465,720	4,104,006
Derivative Liabilities	37,687	42,537
Total liabilities carried at fair value	37,687	42,537
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total assets carried at fair value	0	0
Derivative Liabilities	0	0
Total liabilities carried at fair value	0	0
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total assets carried at fair value	4,344,726	3,998,761
Derivative Liabilities	37,687	42,537
Total liabilities carried at fair value	37,687	42,537
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Total assets carried at fair value	120,994	105,245
Derivative Liabilities	0	0
Total liabilities carried at fair value	0	0
Agency MBS [Member] | Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value, Fair Value Disclosure [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	3,848,434	3,492,659
Agency MBS [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	0	0
Agency MBS [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	3,848,434	3,492,659
Agency MBS [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	0	0
Non-Agency MBS [Member] | Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value, Fair Value Disclosure [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	617,261	611,322
Non-Agency MBS [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	0	0
Non-Agency MBS [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	496,292	506,102
Non-Agency MBS [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Mortgage-backed securities, at fair value	120,969	105,220
Other Investments [Member] | Fair Value, Measurements, Recurring [Member] | Estimate of Fair Value, Fair Value Disclosure [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Other Investments, Fair Value Disclosure	25	25
Other Investments [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Other Investments, Fair Value Disclosure	0	0
Other Investments [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Other Investments, Fair Value Disclosure	0	0
Other Investments [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Other Investments, Fair Value Disclosure	$ 25	$ 25