Learn how to maximize protection and reduce security & operational costs.

Download guide
protecting foss from ai crawlers with free crowdsec blocklist

Protecting FOSS Communities from AI Crawlers with Free CrowdSec Blocklist

Nowadays, Free and Open Source Software (FOSS) communities are facing a growing challenge: AI-driven crawlers dominating web traffic. 

These crawlers overwhelm servers, scrape data, and cause performance issues. In some cases, they even take down a project’s infrastructure, causing outages or forcing the blocking of entire countries to mitigate the damage. As this issue continues to grow, FOSS communities need a reliable (and cost-effective) solution to protect their resources and ensure long-term stability.

To help combat this challenge, we introduced the AI Crawlers Blocklist in February of this year. This blocklist is designed to detect and block malicious AI crawlers that scrape and overload websites and can help FOSS communities reduce the unwanted traffic from AI bots and make their projects stable again for their members. 

However, since this blocklist is part of our Platinum Blocklists plan, we realize that can be quite spendy and impossible for open source projects to afford. 

Announcing free access to the Platinum AI Crawlers Blocklist for all FOSS projects

Open source is the essence of the CrowdSec DNA. Everyone on the CrowdSec team believes that open source communities are critical to the ecosystem and we will always strive to give back to the FOSS community and support open source projects in any shape or form we can.

We know how challenging it can be to manage a project that relies on public collaboration while operating with limited resources. That is why allowing free access to one of our most valuable blocklists for open source projects was a no-brainer.

How to access the AI Crawlers Blocklist

CrowdSec Blocklists don’t require the integration of a specific WAF or service into your stack. 

You just need to feed the blocklist to your existing firewall, proxy, or CDN. For more details, check out this article. Although the AI Crawlers Blocklist is part of our Platinum Blocklists plan, we offer it at no cost to FOSS communities, and here’s how you can access it:

  • Reach out: Contact us at community@crowdsec.com and let us know you’re interested.
  • Tell us about your project: Share a bit about your open source project so we can better understand how the blocklist can help.
  • Get access: Once approved, you will receive access to the blocklist via the CrowdSec Console.

We are safer together!

At CrowdSec, we’re committed to making the internet a safer space for everyone. The rise of AI-driven crawlers brings a significant threat to open source projects and the open source communities we dearly love and support. 

That’s why we won’t let you face this new challenge alone! By making this blocklist available at no cost for FOSS communities, we want to support the open source ecosystem as a whole while also increasing awareness about the importance of community-driven security.
Stay safe out there, and don’t hesitate to reach out to us with any questions or feedback on our Discourse or Discord.

WRITTEN BY

You may also like

Explore and Prioritize Vulnerabilities with the CrowdSec CVE Explorer
Announcement

Explore and Prioritize Vulnerabilities with the CrowdSec CVE Explorer

Introducing our new CVE Explorer. Learn what it is and how it can help your organization prioritize threats and vulnerabilities.

When Hackers Go Back to School: Introducing CrowdSec Education and Public Sector Blocklists
Announcement

When Hackers Go Back to School: Introducing CrowdSec Education and Public Sector Blocklists

CrowdSec’s new Education and Public Sector Blocklists deliver proactive cybersecurity powered by real-world attack data & AI insights.

crowdsec notification center: slack
Announcement

Introducing CrowdSec’s New Notification Center: Seamless Integrations and Custom Alerts

CrowdSec now allows you to configure notifications directly from the Console and integrate with Slack. Stay alert and secure with ease.