Investment Securities - Schedule of Investment Securities (Details) - USD ($) $ in Thousands	Jun. 30, 2021	Dec. 31, 2020
Investment securities:
Available-for-sale:
Amount Outstanding	$ 3,807,593	$ 3,826,582
Unamortized Premium/(Discount)	0	0
Amortized cost	3,817,578	3,843,666
Allowance for losses	(58)	(36)
Unrealized Gains	16,066	13,642
Unrealized Losses	(1,354)	(3,580)
Fair Value	3,832,232	3,853,692
Held-to-maturity:
Unamortized Premium/(Discount)	0	0
Total held-to-maturity
Amount Outstanding	45,032	45,032
Unamortized Premium/(Discount)	0	0
Amortized Cost	45,032	45,032
Allowance for losses	0	0
Unrealized Gains	0	1,201
Unrealized Losses	(198)	0
Fair Value	44,834	46,233
Available-for-sale, accrued interest excluded	6,200	9,000
Available-for-Sale Securities \| Investment securities:
Available-for-sale:
Unamortized Premium/(Discount)	9,985	17,084
Held-to-maturity:
Unamortized Premium/(Discount)	9,985	17,084
Total held-to-maturity
Unamortized Premium/(Discount)	9,985	17,084
Floating Interest Rate \| Floating rate auction-rate certificates backed by Government guaranteed student loans
Available-for-sale:
Amount Outstanding	19,700	19,700
Amortized cost	19,700	19,700
Allowance for losses	(58)	(36)
Unrealized Gains	0	0
Unrealized Losses	(394)	(493)
Fair Value	19,248	19,171
Floating Interest Rate \| Floating rate asset-backed securities
Available-for-sale:
Amount Outstanding		6,232
Amortized cost		6,232
Allowance for losses		0
Unrealized Gains		0
Unrealized Losses		(1)
Fair Value		6,231
Floating Interest Rate \| Guaranteed mortgage-backed securities
Available-for-sale:
Amount Outstanding	2,459,511	2,350,963
Amortized cost	2,459,519	2,350,919
Allowance for losses	0	0
Unrealized Gains	15,833	12,150
Unrealized Losses	(652)	(3,043)
Fair Value	2,474,700	2,360,026
Floating Interest Rate \| Available-for-Sale Securities \| Floating rate auction-rate certificates backed by Government guaranteed student loans
Available-for-sale:
Unamortized Premium/(Discount)	0	0
Held-to-maturity:
Unamortized Premium/(Discount)	0	0
Total held-to-maturity
Unamortized Premium/(Discount)	0	0
Floating Interest Rate \| Available-for-Sale Securities \| Floating rate asset-backed securities
Available-for-sale:
Unamortized Premium/(Discount)		0
Held-to-maturity:
Unamortized Premium/(Discount)		0
Total held-to-maturity
Unamortized Premium/(Discount)		0
Floating Interest Rate \| Available-for-Sale Securities \| Guaranteed mortgage-backed securities
Available-for-sale:
Unamortized Premium/(Discount)	8	(44)
Held-to-maturity:
Unamortized Premium/(Discount)	8	(44)
Total held-to-maturity
Unamortized Premium/(Discount)	8	(44)
Fixed Interest Rate \| Guaranteed mortgage-backed securities
Available-for-sale:
Amount Outstanding	28,174	279
Amortized cost	28,981	279
Allowance for losses	0	0
Unrealized Gains	29	34
Unrealized Losses	0	0
Fair Value	29,010	313
Held-to-maturity:
Amount Outstanding	45,032	45,032
Amortized Cost	45,032	45,032
Allowance for losses	0	0
Unrealized Gains	0	1,201
Unrealized Losses	(198)	0
Fair Value	$ 44,834	$ 46,233
Total held-to-maturity
Held-to-maturity investment securities weighted average yield	1.50%	1.50%
Fixed Interest Rate \| Fixed rate U.S. Treasuries
Available-for-sale:
Amount Outstanding	$ 1,300,208	$ 1,449,408
Amortized cost	1,309,378	1,466,536
Allowance for losses	0	0
Unrealized Gains	204	1,458
Unrealized Losses	(308)	(43)
Fair Value	1,309,274	1,467,951
Fixed Interest Rate \| Available-for-Sale Securities \| Guaranteed mortgage-backed securities
Available-for-sale:
Unamortized Premium/(Discount)	807	0
Held-to-maturity:
Unamortized Premium/(Discount)	807	0
Total held-to-maturity
Unamortized Premium/(Discount)	807	0
Fixed Interest Rate \| Available-for-Sale Securities \| Fixed rate U.S. Treasuries
Available-for-sale:
Unamortized Premium/(Discount)	9,170	17,128
Held-to-maturity:
Unamortized Premium/(Discount)	9,170	17,128
Total held-to-maturity
Unamortized Premium/(Discount)	9,170	17,128
Fixed Interest Rate \| Held-to-Maturity Securities \| Guaranteed mortgage-backed securities
Available-for-sale:
Unamortized Premium/(Discount)	0	0
Held-to-maturity:
Unamortized Premium/(Discount)	0	0
Total held-to-maturity
Unamortized Premium/(Discount)	$ 0	$ 0

Debt Securities, Available-for-Sale, Unpaid Principal Balance

No definition available.

Name:	agm_DebtSecuritiesAvailableforSaleUnpaidPrincipalBalance
Namespace Prefix:	agm_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Debt Securities, Held-to-Maturity, Amortized Cost, Excluding Accrued Interest, before Allowance for Credit Loss

+ References

No definition available.

+ Details

Name:	agm_DebtSecuritiesHeldToMaturityAmortizedCostExcludingAccruedInterestBeforeAllowanceForCreditLoss
Namespace Prefix:	agm_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Held-to-Maturity Securities, Debt Maturities, Weighted-Average Yield

+ References

No definition available.

+ Details

Name:	agm_HeldtoMaturitySecuritiesDebtMaturitiesWeightedAverageYield
Namespace Prefix:	agm_
Data Type:	dtr-types:percentItemType
Balance Type:	na
Period Type:	instant

- Definition

Held-to-Maturity Unpaid Principal Balance

+ References

No definition available.

+ Details

Name:	agm_HeldtoMaturityUnpaidPrincipalBalance
Namespace Prefix:	agm_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Marketable Securities, Allowance for Credit Loss

+ References

No definition available.

+ Details

Name:	agm_MarketableSecuritiesAllowanceForCreditLoss
Namespace Prefix:	agm_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Marketable Securities, Amortized Cost Basis

+ References

No definition available.

+ Details

Name:	agm_MarketableSecuritiesAmortizedCostBasis
Namespace Prefix:	agm_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Marketable Securities, Gross Unrealized Gains

+ References

No definition available.

+ Details

Name:	agm_MarketableSecuritiesGrossUnrealizedGains
Namespace Prefix:	agm_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Marketable Securities, Gross Unrealized Losses

+ References

No definition available.

+ Details

Name:	agm_MarketableSecuritiesGrossUnrealizedLosses
Namespace Prefix:	agm_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Marketable Securities Unpaid Principal Balance

+ References

No definition available.

+ Details

Name:	agm_MarketableSecuritiesUnpaidPrincipalBalance
Namespace Prefix:	agm_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount, before tax, of unrealized gain in accumulated other comprehensive income (AOCI) on investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=123581744&loc=d3e27161-111563

+ Details

Name:	us-gaap_AvailableForSaleDebtSecuritiesAccumulatedGrossUnrealizedGainBeforeTax
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount, before tax, of unrealized loss in accumulated other comprehensive income (AOCI) on investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 2
-Subparagraph (c)
-URI http://asc.fasb.org/extlink&oid=123581744&loc=d3e27161-111563

+ Details

Name:	us-gaap_AvailableForSaleDebtSecuritiesAccumulatedGrossUnrealizedLossBeforeTax
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- References

No definition available.

+ Details

Name:	us-gaap_AvailableForSaleSecuritiesAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Amount, after accumulated amortization, of debt discount (premium).

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 835
-SubTopic 30
-Section 45
-Paragraph 3
-URI http://asc.fasb.org/extlink&oid=124435984&loc=d3e28555-108399

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 835
-SubTopic 30
-Section 45
-Paragraph 2
-URI http://asc.fasb.org/extlink&oid=124435984&loc=d3e28551-108399

Reference 3: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 835
-SubTopic 30
-Section 45
-Paragraph 4
-URI http://asc.fasb.org/extlink&oid=124435984&loc=d3e28567-108399

Reference 4: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 835
-SubTopic 30
-Section 45
-Paragraph 1A
-URI http://asc.fasb.org/extlink&oid=124435984&loc=d3e28541-108399

Reference 5: http://www.xbrl.org/2009/role/commonPracticeRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 470
-SubTopic 20
-Section 50
-Paragraph 1D
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=123466505&loc=SL123495340-112611

Reference 6: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 835
-SubTopic 30
-Section 55
-Paragraph 8
-URI http://asc.fasb.org/extlink&oid=114775985&loc=d3e28878-108400

+ Details

Name:	us-gaap_DebtInstrumentUnamortizedDiscountPremiumNet
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount, after allowance for credit loss, of accrued interest on investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 45
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=124258926&loc=SL82898722-210454

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 50
-Paragraph 3A
-URI http://asc.fasb.org/extlink&oid=124269663&loc=SL120267853-210455

Reference 3: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 2A
-URI http://asc.fasb.org/extlink&oid=123581744&loc=SL121698322-111563

Reference 4: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 50
-Paragraph 3B
-URI http://asc.fasb.org/extlink&oid=124269663&loc=SL120267856-210455

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleAccruedInterestAfterAllowanceForCreditLoss
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount excluding accrued interest, of allowance for credit loss on investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleAmortizedCostAllowanceForCreditLossExcludingAccruedInterest
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amortized cost excluding accrued interest, before allowance for credit loss, of investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleAmortizedCostExcludingAccruedInterestBeforeAllowanceForCreditLoss
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount, after allowance for credit loss, of investment in debt security measured at amortized cost (held-to-maturity) and investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 942
-SubTopic 210
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-03(6))
-URI http://asc.fasb.org/extlink&oid=120398452&loc=d3e534808-122878

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleAndHeldToMaturity
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount excluding accrued interest, of investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale).

+ References

Reference 1: http://www.xbrl.org/2009/role/commonPracticeRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 45
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=124258926&loc=SL82898722-210454

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleExcludingAccruedInterest
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount, excluding accrued interest, of allowance for credit loss on investment in debt security measured at amortized cost (held-to-maturity).

+ References

Reference 1: http://www.xbrl.org/2009/role/commonPracticeRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 45
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=124255206&loc=SL82895884-210446

+ Details

Name:	us-gaap_DebtSecuritiesHeldToMaturityAllowanceForCreditLossExcludingAccruedInterest
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount excluding accrued interest, after allowance for credit loss, of investment in debt security measured at amortized cost (held-to-maturity).

+ References

+ Details

Name:	us-gaap_DebtSecuritiesHeldToMaturityExcludingAccruedInterestAfterAllowanceForCreditLoss
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of accumulated unrecognized gain on investment in debt security measured at amortized cost (held-to-maturity).

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 5
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=123581744&loc=d3e27232-111563

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 5A
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=123581744&loc=SL120269820-111563

+ Details

Name:	us-gaap_HeldToMaturitySecuritiesAccumulatedUnrecognizedHoldingGain
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of accumulated unrealized loss on investment in debt security measured at amortized cost (held-to-maturity).

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 5
-Subparagraph (c)
-URI http://asc.fasb.org/extlink&oid=123581744&loc=d3e27232-111563

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 5A
-Subparagraph (c)
-URI http://asc.fasb.org/extlink&oid=123581744&loc=SL120269820-111563

+ Details

Name:	us-gaap_HeldToMaturitySecuritiesAccumulatedUnrecognizedHoldingLoss
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- References

No definition available.

+ Details

Name:	us-gaap_HeldToMaturitySecuritiesClassifiedAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- References

No definition available.

+ Details

Name:	us-gaap_MarketableSecuritiesAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_DebtSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_InformationByCategoryOfDebtSecurityAxis=us-gaap_AvailableforsaleSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	srt_ProductOrServiceAxis=agm_FloatingInterestRateMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_AuctionRateSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_AssetBackedSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_MortgageBackedSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	srt_ProductOrServiceAxis=agm_FixedInterestRateMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_USTreasurySecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_InformationByCategoryOfDebtSecurityAxis=us-gaap_HeldtomaturitySecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: