Financial Derivatives - Schedule of Derivative Instruments in Statement of Financial Position (Details) - USD ($) $ / shares in Units, $ in Thousands	3 Months Ended
Mar. 31, 2019	Mar. 31, 2018	Dec. 31, 2018
Notional Disclosures [Abstract]
Notional Amount	$ 11,808,479		$ 9,955,745
Fair Value
Asset	6,053		7,487
Collateral (held)/pledged	(3,900)		(1,778)
Net amount	2,153		5,709
(Liability)	(22,203)		(19,633)
Collateral (held)/pledged	90,420		47,018
Net amount	68,217		27,385
Designated as Hedging Instrument [Member] \| Fair Value Hedging [Member] \| Interest Rate Swap, Pay Fixed Non-Callable [Member]
Notional Disclosures [Abstract]
Notional Amount	4,085,824		3,097,084
Fair Value
Asset	1,489		3,004
(Liability)	$ (5,981)		$ (4,326)
Weighted- Average Pay Rate	2.49%		2.42%
Weighted- Average Receive Rate	2.63%		2.58%
Weighted- Average Remaining Term (in years)	11 years 9 months 72 days	9 years 8 months 29 days
Designated as Hedging Instrument [Member] \| Fair Value Hedging [Member] \| Interest Rate Swap, Receive Fixed Non-Callable [Member]
Notional Disclosures [Abstract]
Notional Amount	$ 1,760,200		$ 1,871,200
Fair Value
Asset	807		547
(Liability)	$ (4,163)		$ (4,484)
Weighted- Average Pay Rate	2.61%		2.50%
Weighted- Average Receive Rate	1.88%		1.84%
Weighted- Average Remaining Term (in years)	1 year 4 months 30 days	1 year 6 months 30 days
Designated as Hedging Instrument [Member] \| Fair Value Hedging [Member] \| Interest Rate Swap, Receive Fixed Callable [Member]
Notional Disclosures [Abstract]
Notional Amount	$ 370,000		$ 160,000
Fair Value
Asset	617		338
(Liability)	$ (1)		$ (28)
Weighted- Average Pay Rate	2.36%		2.35%
Weighted- Average Receive Rate	2.63%		3.06%
Weighted- Average Remaining Term (in years)	2 years 4 months 55 days	2 years 9 months 60 days
Designated as Hedging Instrument [Member] \| Cash Flow Hedging [Member] \| Interest Rate Swap, Pay Fixed Non-Callable [Member]
Notional Disclosures [Abstract]
Notional Amount	$ 373,000		$ 373,000
Fair Value
Asset	2,043		2,441
(Liability)	$ (144)		$ (99)
Weighted- Average Pay Rate	2.40%		2.40%
Weighted- Average Receive Rate	2.91%		2.83%
Weighted- Average Remaining Term (in years)	5 years 8 months 75 days	6 years 1 month 12 days
Not Designated as Hedging Instrument [Member]
Fair Value
Credit valuation adjustment	$ (25)		$ (60)
Credit valuation adjustment	39		21
Not Designated as Hedging Instrument [Member] \| Interest Rate Swap, Pay Fixed Non-Callable [Member]
Notional Disclosures [Abstract]
Notional Amount	316,534		316,664
Fair Value
Asset	281		796
(Liability)	$ (11,785)		$ (10,399)
Weighted- Average Pay Rate	3.69%		3.69%
Weighted- Average Receive Rate	2.74%		2.52%
Weighted- Average Remaining Term (in years)	6 years	6 years 2 months 29 days
Not Designated as Hedging Instrument [Member] \| Interest Rate Swap, Receive Fixed Non-Callable [Member]
Notional Disclosures [Abstract]
Notional Amount	$ 2,886,621		$ 2,347,371
Fair Value
Asset	0		0
(Liability)	$ 0		$ 0
Weighted- Average Pay Rate	2.56%		2.37%
Weighted- Average Receive Rate	2.36%		2.10%
Weighted- Average Remaining Term (in years)	9 months 80 days	10 months 10 days
Not Designated as Hedging Instrument [Member] \| Basis Swap [Member]
Notional Disclosures [Abstract]
Notional Amount	$ 2,004,000		$ 1,770,026
Fair Value
Asset	841		421
(Liability)	$ (74)		$ (130)
Weighted- Average Pay Rate	2.58%		2.45%
Weighted- Average Receive Rate	2.56%		2.49%
Weighted- Average Remaining Term (in years)	1 year 2 months 20 days	1 year 3 months 7 days
Not Designated as Hedging Instrument [Member] \| Future [Member]
Notional Disclosures [Abstract]
Notional Amount	$ 12,300		$ 20,400
Fair Value
Asset			0
(Liability)	$ (94)		$ (188)
Weighted- Average Forward Price (in dollars per share)	$ 123.46	$ 121.09

Derivative, Weighted-Average Forward Price

No definition available.

Name:	agm_DerivativeWeightedAverageForwardPrice
Namespace Prefix:	agm_
Data Type:	num:perShareItemType
Balance Type:	na
Period Type:	duration

- Definition

Aggregate notional amount specified by the derivative(s). Expressed as an absolute value.

+ References

Reference 1: http://www.xbrl.org/2003/role/presentationRef
-Publisher SEC
-Name Regulation S-X (SX)
-Number 210
-Article 12
-Section 13
-Sentence Column B

+ Details

Name:	invest_DerivativeNotionalAmount
Namespace Prefix:	invest_
Data Type:	xbrli:monetaryItemType
Balance Type:	na
Period Type:	instant

- Definition

The aggregate fair value of assets that are already posted, at the end of the reporting period, as collateral for derivative instruments with credit-risk-related contingent features.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 815
-SubTopic 10
-Section 50
-Paragraph 4H
-Subparagraph (d)
-URI http://asc.fasb.org/extlink&oid=109980867&loc=SL5624258-113959

+ Details

Name:	us-gaap_CollateralAlreadyPostedAggregateFairValue
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- References

No definition available.

+ Details

Name:	us-gaap_DerivativeAssetFairValueNetAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Fair value of securities received as collateral against derivative assets.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 55
-Paragraph 12
-URI http://asc.fasb.org/extlink&oid=99393222&loc=SL20226013-175313

+ Details

Name:	us-gaap_DerivativeAssetFairValueOfCollateral
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Fair value, after the effects of master netting arrangements, of a financial asset or other contract with one or more underlyings, notional amount or payment provision or both, and the contract can be net settled by means outside the contract or delivery of an asset. Includes assets not subject to a master netting arrangement and not elected to be offset.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 55
-Paragraph 10
-URI http://asc.fasb.org/extlink&oid=99393222&loc=SL20226008-175313

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 825
-SubTopic 10
-Section 50
-Paragraph 10
-URI http://asc.fasb.org/extlink&oid=109250915&loc=d3e13433-108611

Reference 3: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 50
-Paragraph 3
-Subparagraph (c)
-URI http://asc.fasb.org/extlink&oid=51824906&loc=SL20225862-175312

+ Details

Name:	us-gaap_DerivativeAssets
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Average fixed interest rate related to the group of interest rate derivatives.

+ References

No definition available.

+ Details

Name:	us-gaap_DerivativeAverageFixedInterestRate
Namespace Prefix:	us-gaap_
Data Type:	num:percentItemType
Balance Type:	na
Period Type:	instant

- Definition

Average remaining period until maturity of the derivative contract, in 'PnYnMnDTnHnMnS' format, for example, 'P1Y5M13D' represents the reported fact of one year, five months, and thirteen days.

+ References

No definition available.

+ Details

Name:	us-gaap_DerivativeAverageRemainingMaturity1
Namespace Prefix:	us-gaap_
Data Type:	xbrli:durationItemType
Balance Type:	na
Period Type:	duration

- Definition

Average variable interest rate related to the group of interest rate derivatives.

+ References

No definition available.

+ Details

Name:	us-gaap_DerivativeAverageVariableInterestRate
Namespace Prefix:	us-gaap_
Data Type:	num:percentItemType
Balance Type:	na
Period Type:	instant

- Definition

Amount of credit risk valuation adjustment to derivative assets to properly reflect the credit quality of the counterparties.

+ References

No definition available.

+ Details

Name:	us-gaap_DerivativeCreditRiskValuationAdjustmentDerivativeAssets
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of credit risk valuation adjustment to derivative liabilities to properly reflect the credit quality of the entity.

+ References

No definition available.

+ Details

Name:	us-gaap_DerivativeCreditRiskValuationAdjustmentDerivativeLiabilities
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Fair value, before effects of master netting arrangements, of a financial asset or other contract with one or more underlyings, notional amount or payment provision or both, and the contract can be net settled by means outside the contract or delivery of an asset. Includes assets elected not to be offset. Excludes assets not subject to a master netting arrangement.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 55
-Paragraph 7
-URI http://asc.fasb.org/extlink&oid=99393222&loc=SL20226000-175313

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 860
-SubTopic 20
-Section 50
-Paragraph 4D
-Subparagraph (c)(2)
-URI http://asc.fasb.org/extlink&oid=109247956&loc=SL51823488-111719

Reference 3: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 50
-Paragraph 3
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=51824906&loc=SL20225862-175312

Reference 4: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 815
-SubTopic 10
-Section 50
-Paragraph 4B
-Subparagraph (a),(c)
-URI http://asc.fasb.org/extlink&oid=109980867&loc=SL5624163-113959

+ Details

Name:	us-gaap_DerivativeFairValueOfDerivativeAsset
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Fair value, before effects of master netting arrangements, of a financial liability or contract with one or more underlyings, notional amount or payment provision or both, and the contract can be net settled by means outside the contract or delivery of an asset. Includes liabilities elected not to be offset. Excludes liabilities not subject to a master netting arrangement.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 860
-SubTopic 20
-Section 50
-Paragraph 4D
-Subparagraph (c)(2)
-URI http://asc.fasb.org/extlink&oid=109247956&loc=SL51823488-111719

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 815
-SubTopic 10
-Section 50
-Paragraph 4B
-Subparagraph (a),(c)
-URI http://asc.fasb.org/extlink&oid=109980867&loc=SL5624163-113959

Reference 3: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 50
-Paragraph 3
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=51824906&loc=SL20225862-175312

Reference 4: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 55
-Paragraph 7
-URI http://asc.fasb.org/extlink&oid=99393222&loc=SL20226000-175313

+ Details

Name:	us-gaap_DerivativeFairValueOfDerivativeLiability
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Fair value, after the effects of master netting arrangements, of a financial liability or contract with one or more underlyings, notional amount or payment provision or both, and the contract can be net settled by means outside the contract or delivery of an asset. Includes liabilities not subject to a master netting arrangement and not elected to be offset.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 50
-Paragraph 3
-Subparagraph (c)
-URI http://asc.fasb.org/extlink&oid=51824906&loc=SL20225862-175312

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 825
-SubTopic 10
-Section 50
-Paragraph 10
-URI http://asc.fasb.org/extlink&oid=109250915&loc=d3e13433-108611

Reference 3: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 55
-Paragraph 10
-URI http://asc.fasb.org/extlink&oid=99393222&loc=SL20226008-175313

+ Details

Name:	us-gaap_DerivativeLiabilities
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- References

No definition available.

+ Details

Name:	us-gaap_NotionalAmountOfDerivativesAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Details

Name:	us-gaap_HedgingDesignationAxis=us-gaap_DesignatedAsHedgingInstrumentMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_DerivativeInstrumentsGainLossByHedgingRelationshipAxis=us-gaap_FairValueHedgingMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_DerivativeInstrumentRiskAxis=agm_InterestRateSwapPayFixedNonCallableMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_DerivativeInstrumentRiskAxis=agm_InterestRateSwapReceiveFixedNonCallableMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_DerivativeInstrumentRiskAxis=agm_InterestRateSwapReceiveFixedCallableMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_DerivativeInstrumentsGainLossByHedgingRelationshipAxis=us-gaap_CashFlowHedgingMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_HedgingDesignationAxis=us-gaap_NondesignatedMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_DerivativeInstrumentRiskAxis=us-gaap_BasisSwapMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_DerivativeInstrumentRiskAxis=us-gaap_FutureMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: