Resale and Repurchase Agreements Remaining Contractual Maturities of Repurchase Agreements (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
U.S. Government and Federal Agency Obligations [Member] | Maturity Overnight [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	$ 295,051	$ 526,283
U.S. Government and Federal Agency Obligations [Member] | Maturity up to 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	0	0
U.S. Government and Federal Agency Obligations [Member] | Maturity over 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	0	0
U.S. Government and Federal Agency Obligations [Member] | Total Repurchase Agreements [Member] [Domain]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	295,051	526,283
Government-Sponsored Enterprise Obligations [Member] | Maturity Overnight [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	21,567	32,575
Government-Sponsored Enterprise Obligations [Member] | Maturity up to 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	0	0
Government-Sponsored Enterprise Obligations [Member] | Maturity over 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	0	0
Government-Sponsored Enterprise Obligations [Member] | Total Repurchase Agreements [Member] [Domain]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	21,567	32,575
Agency Mortgage-Backed Securities [Member] | Maturity Overnight [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	789,547	973,774
Agency Mortgage-Backed Securities [Member] | Maturity up to 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	40,979	48,517
Agency Mortgage-Backed Securities [Member] | Maturity over 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	238,743	227,802
Agency Mortgage-Backed Securities [Member] | Total Repurchase Agreements [Member] [Domain]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	1,069,269	1,250,093
Non Agency Mortgage Backed Securities [Member] | Maturity Overnight [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	128,352	71,399
Non Agency Mortgage Backed Securities [Member] | Maturity up to 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	0	0
Non Agency Mortgage Backed Securities [Member] | Maturity over 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	0	0
Non Agency Mortgage Backed Securities [Member] | Total Repurchase Agreements [Member] [Domain]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	128,352	71,399
Asset-Backed Securities [Member] | Maturity Overnight [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	43,008	60,012
Asset-Backed Securities [Member] | Maturity up to 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	0	40,000
Asset-Backed Securities [Member] | Maturity over 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	25,000	0
Asset-Backed Securities [Member] | Total Repurchase Agreements [Member] [Domain]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	68,008	100,012
Other Debt Securities [Member] | Maturity Overnight [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	27,046	50,375
Other Debt Securities [Member] | Maturity up to 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	0	0
Other Debt Securities [Member] | Maturity over 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	0	0
Other Debt Securities [Member] | Total Repurchase Agreements [Member] [Domain]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	27,046	50,375
Repurchase Agreements [Member] | Maturity Overnight [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	1,304,571	1,714,418
Repurchase Agreements [Member] | Maturity up to 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	40,979	88,517
Repurchase Agreements [Member] | Maturity over 90 days [Member]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	263,743	227,802
Repurchase Agreements [Member] | Total Repurchase Agreements [Member] [Domain]
Assets Sold under Agreements to Repurchase [Line Items]
Assets Sold under Agreements to Repurchase, Repurchase Liability	$ 1,609,293	$ 2,030,737