SEC to apply new rate control limits to EDGAR websites
July 27, 2021
To ensure that automated searches do not affect the ability of other users to access EDGAR websites, the SEC will limit automated searches to a total of no more than 10 requests per second regardless of the number of machines used to submit requests. This action—consistent with the agency’s Internet Security Policy—will be deployed today, July 27, 2021, starting with the EDGAR Portal and EDGAR Company Database.
If a user or application submits more than 10 requests per second to EDGAR websites, the SEC may limit further requests from the relevant IP address(es) for a brief period. When the rate of requests drops below the 10-requests-per-second threshold, the user will be able to resume access to these websites. This practice is designed to limit excessive automated searches and is not intended or expected to impact use by individuals.
As stated in the Internet Security Policy, the SEC does not allow "unclassified" bots or automated tools to crawl agency websites. Any request that the SEC identifies as part of an unclassified bot or an automated tool that exceeds 10 requests per second will be managed to ensure fair access for all users.
The SEC does not offer technical support for developing or debugging scripted processes.