Changelog
Cloudflare will prepend our managed robots.txt before your existing robots.txt, combining both into a single response.
Web Bot Auth is an authentication method that leverages cryptographic signatures in HTTP messages to verify that a request comes from an automated bot. This provides a more robust way of verifying bots.
Events detected by the anomaly detection engine are now given a bot score of 2.
Machine Learning model v9 is now the default model for all new zones and existing zones set to use the latest machine learning model.
Direct AI crawlers on what they can and cannot scrape from your website or application by implementing a robots.txt file to your domain.
You can now create a Bot Detection Alert to notify you when Cloudflare detects a spike in Bot traffic on your website.
AI bots protection has been upgraded from a custom rule to a managed rule.
Was this helpful?
- Resources
- API
- New to Cloudflare?
- Products
- Sponsorships
- Open Source
- Support
- Help Center
- System Status
- Compliance
- GDPR
- Company
- cloudflare.com
- Our team
- Careers
- 2025 Cloudflare, Inc.
- Privacy Policy
- Terms of Use
- Report Security Issues
- Trademark