Investment Securities - Unrealized Loss Position (Details) $ in Thousands	Mar. 31, 2021 USD ($) security	Dec. 31, 2020 USD ($) security
Debt Securities, Available-for-sale [Line Items]
Unrealized loss position for less than 12 months, Fair Value	$ 421,167	$ 537,162
Unrealized loss position for less than 12 months, Unrealized Loss	(483)	(636)
Unrealized loss position for more than 12 months, Fair Value	313,022	349,825
Unrealized loss position for more than 12 months, Unrealized Loss	$ (2,996)	$ (2,944)
Investment securities:
Debt Securities, Available-for-sale [Line Items]
Unrealized loss position for less than 12 months, Number of securities in loss position \| security	27	27
Unrealized loss position for more than 12 months, Number of securities in loss position \| security	55	62
Floating Interest Rate \| Floating rate auction-rate certificates backed by Government guaranteed student loans
Debt Securities, Available-for-sale [Line Items]
Unrealized loss position for less than 12 months, Fair Value	$ 0	$ 0
Unrealized loss position for less than 12 months, Unrealized Loss	0	0
Unrealized loss position for more than 12 months, Fair Value	19,146	19,171
Unrealized loss position for more than 12 months, Unrealized Loss	(493)	(493)
Floating Interest Rate \| Floating rate asset-backed securities
Debt Securities, Available-for-sale [Line Items]
Unrealized loss position for less than 12 months, Fair Value		0
Unrealized loss position for less than 12 months, Unrealized Loss		0
Unrealized loss position for more than 12 months, Fair Value		6,231
Unrealized loss position for more than 12 months, Unrealized Loss		(1)
Floating Interest Rate \| Guaranteed mortgage-backed securities
Debt Securities, Available-for-sale [Line Items]
Unrealized loss position for less than 12 months, Fair Value	142,747	172,842
Unrealized loss position for less than 12 months, Unrealized Loss	(434)	(593)
Unrealized loss position for more than 12 months, Fair Value	293,876	324,423
Unrealized loss position for more than 12 months, Unrealized Loss	(2,503)	(2,450)
Fixed Interest Rate \| Fixed rate U.S. Treasuries
Debt Securities, Available-for-sale [Line Items]
Unrealized loss position for less than 12 months, Fair Value	278,420	364,320
Unrealized loss position for less than 12 months, Unrealized Loss	(49)	(43)
Unrealized loss position for more than 12 months, Fair Value	0	0
Unrealized loss position for more than 12 months, Unrealized Loss	$ 0	$ 0

Amount of investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale), in continuous unrealized loss position for more than 12 months, without allowance for credit loss. Includes beneficial interest in securitized financial asset.

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 50
-Paragraph 5
-URI http://asc.fasb.org/extlink&oid=121582814&loc=SL82922890-210455

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 7
-URI http://asc.fasb.org/extlink&oid=121645371&loc=d3e27337-111563

Reference 3: http://www.xbrl.org/2003/role/exampleRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 55
-Paragraph 8
-URI http://asc.fasb.org/extlink&oid=121590138&loc=SL82922954-210456

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleContinuousUnrealizedLossPosition12MonthsOrLonger
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of accumulated unrealized loss on investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale), in continuous unrealized loss position for 12 months or longer, without allowance for credit loss. Includes beneficial interest in securitized financial asset.

+ References

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleContinuousUnrealizedLossPosition12MonthsOrLongerAccumulatedLoss
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Number of investments in debt securities measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale), in continuous unrealized loss position for 12 months or longer, without an allowance for credit loss. Includes beneficial interest in securitized financial asset.

+ References

Reference 1: http://www.xbrl.org/2009/role/commonPracticeRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 50
-Paragraph 4
-Subparagraph (b)(3)
-URI http://asc.fasb.org/extlink&oid=121582814&loc=SL82922888-210455

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleContinuousUnrealizedLossPosition12MonthsOrLongerNumberOfPositions
Namespace Prefix:	us-gaap_
Data Type:	xbrli:integerItemType
Balance Type:	na
Period Type:	instant

- Definition

Amount of investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale), in continuous unrealized loss position for less than 12 months, without allowance for credit loss. Includes beneficial interest in securitized financial asset.

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 320
-SubTopic 10
-Section 50
-Paragraph 7
-URI http://asc.fasb.org/extlink&oid=121645371&loc=d3e27337-111563

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 50
-Paragraph 5
-URI http://asc.fasb.org/extlink&oid=121582814&loc=SL82922890-210455

Reference 3: http://www.xbrl.org/2003/role/exampleRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 30
-Section 55
-Paragraph 8
-URI http://asc.fasb.org/extlink&oid=121590138&loc=SL82922954-210456

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleContinuousUnrealizedLossPositionLessThan12Months
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of accumulated unrealized loss on investment in debt security measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale), in continuous unrealized loss position for less than 12 months, without allowance for credit loss. Includes beneficial interest in securitized financial asset.

+ References

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleContinuousUnrealizedLossPositionLessThan12MonthsAccumulatedLoss
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Number of investments in debt securities measured at fair value with change in fair value recognized in other comprehensive income (available-for-sale), in continuous unrealized loss position for less than 12 months, without an allowance for credit loss. Includes beneficial interest in securitized financial asset.

+ References

+ Details

Name:	us-gaap_DebtSecuritiesAvailableForSaleContinuousUnrealizedLossPositionLessThan12MonthsNumberOfPositions
Namespace Prefix:	us-gaap_
Data Type:	xbrli:integerItemType
Balance Type:	na
Period Type:	instant

- Definition

Line items represent financial concepts included in a table. These concepts are used to disclose reportable information associated with domain members defined in one or many axes to the table.

+ References

No definition available.

+ Details

Name:	us-gaap_ScheduleOfAvailableForSaleSecuritiesLineItems
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_DebtSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	srt_ProductOrServiceAxis=agm_FloatingInterestRateMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_AuctionRateSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_AssetBackedSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_MortgageBackedSecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	srt_ProductOrServiceAxis=agm_FixedInterestRateMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancialInstrumentAxis=us-gaap_USTreasurySecuritiesMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: