SUMMARY OF SIGNIFICANT ACCOUNTING POLICIES - Narrative (Details)	12 Months Ended
Dec. 31, 2023 USD ($) segment subsidiary	Dec. 31, 2022 USD ($)	Dec. 31, 2021 USD ($)
Accounting Policies [Abstract]
Number of subsidiaries \| subsidiary	2
Mortgage loans with an aggregate outstanding principal balance			$ 299,400,000
Percentage of class A securities back by pool in structured securitization			92.50%
Percentage of class B securities back by pool in structured securitization			7.50%
Gain on securitization of financial assets	$ 0	$ 0	$ 6,500,000
Compensation expense	$ 6,800,000	$ 4,600,000	$ 4,300,000
Number of operating segments \| segment	7

Number Of Subsidiaries

No definition available.

Name:	agm_NumberOfSubsidiaries
Namespace Prefix:	agm_
Data Type:	xbrli:integerItemType
Balance Type:	na
Period Type:	instant

- Definition

Percentage Of Class A Securities Back By Pool In Structured Securitization

+ References

No definition available.

+ Details

Name:	agm_PercentageOfClassASecuritiesBackByPoolInStructuredSecuritization
Namespace Prefix:	agm_
Data Type:	dtr-types1:percentItemType
Balance Type:	na
Period Type:	instant

- Definition

Percentage Of Class B Securities Back By Pool In Structured Securitization

+ References

No definition available.

+ Details

Name:	agm_PercentageOfClassBSecuritiesBackByPoolInStructuredSecuritization
Namespace Prefix:	agm_
Data Type:	dtr-types1:percentItemType
Balance Type:	na
Period Type:	instant

- References

No definition available.

+ Details

Name:	us-gaap_AccountingPoliciesAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Amount of expense for award under share-based payment arrangement. Excludes amount capitalized.

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Topic 718
-SubTopic 10
-Name Accounting Standards Codification
-Section S99
-Paragraph 1
-Subparagraph (SAB Topic 14.F)
-Publisher FASB
-URI https://asc.fasb.org//1943274/2147479830/718-10-S99-1

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Topic 718
-SubTopic 10
-Name Accounting Standards Codification
-Section 50
-Paragraph 2
-Subparagraph (h)(1)(i)
-Publisher FASB
-URI https://asc.fasb.org//1943274/2147480429/718-10-50-2

+ Details

Name:	us-gaap_AllocatedShareBasedCompensationExpense
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	duration

- Definition

A gain (loss) realized on a transfer, accounted for as a sale, of all or a portion of financial assets in which the transferor surrenders control and receives consideration other than a beneficial interest in the assets transferred. Reflects the amount of sales proceeds in excess of, or deficient from, the sum of the carrying amounts of transferred financial assets plus transaction costs.

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Topic 860
-SubTopic 20
-Name Accounting Standards Codification
-Section 50
-Paragraph 3
-Subparagraph (b)(3)
-Publisher FASB
-URI https://asc.fasb.org//1943274/2147481326/860-20-50-3

Reference 2: http://www.xbrl.org/2009/role/commonPracticeRef
-Topic 230
-SubTopic 10
-Name Accounting Standards Codification
-Section 45
-Paragraph 28
-Subparagraph (b)
-Publisher FASB
-URI https://asc.fasb.org//1943274/2147482740/230-10-45-28

Reference 3: http://www.xbrl.org/2009/role/commonPracticeRef
-Topic 220
-SubTopic 10
-Name Accounting Standards Codification
-Section S99
-Paragraph 2
-Subparagraph (SX 210.5-03(b)(7)(c))
-Publisher FASB
-URI https://asc.fasb.org//1943274/2147483621/220-10-S99-2

Reference 4: http://www.xbrl.org/2009/role/commonPracticeRef
-Topic 220
-SubTopic 10
-Name Accounting Standards Codification
-Section S99
-Paragraph 2
-Subparagraph (SX 210.5-03(b)(9)(a))
-Publisher FASB
-URI https://asc.fasb.org//1943274/2147483621/220-10-S99-2

Reference 5: http://www.xbrl.org/2009/role/commonPracticeRef
-Topic 942
-SubTopic 220
-Name Accounting Standards Codification
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-04(13))
-Publisher FASB
-URI https://asc.fasb.org//1943274/2147483589/942-220-S99-1

+ Details

Name:	us-gaap_GainLossOnSecuritizationOfFinancialAssets
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	duration

- Definition

Number of operating segments. An operating segment is a component of an enterprise: (a) that engages in business activities from which it may earn revenues and incur expenses (including revenues and expenses relating to transactions with other components of the same enterprise), (b) whose operating results are regularly reviewed by the enterprise's chief operating decision maker to make decisions about resources to be allocated to the segment and assess its performance, and (c) for which discrete financial information is available. An operating segment may engage in business activities for which it has yet to earn revenues, for example, start-up operations may be operating segments before earning revenues.

+ References

Reference 1: http://www.xbrl.org/2009/role/commonPracticeRef
-Topic 280
-SubTopic 10
-Name Accounting Standards Codification
-Section 50
-Paragraph 18
-Publisher FASB
-URI https://asc.fasb.org//1943274/2147482810/280-10-50-18

+ Details

Name:	us-gaap_NumberOfOperatingSegments
Namespace Prefix:	us-gaap_
Data Type:	xbrli:integerItemType
Balance Type:	na
Period Type:	duration

- Definition

This is the principal amount outstanding for securitized loans only (across all types of loans).

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Name Accounting Standards Codification
-Section 50
-Subparagraph (a)
-Paragraph 4
-SubTopic 20
-Topic 860
-Publisher FASB
-URI https://asc.fasb.org//1943274/2147481326/860-20-50-4

+ Details

Name:	us-gaap_PrincipalAmountOutstandingOnLoansSecuritized
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant