Summary

Cloudflare added Redirects for AI Training on April 17 so verified AI training crawlers can be sent to canonical URLs when they request duplicate or deprecated pages. Humans, search crawlers, and AI search agents still see the original URL, making this a crawler-specific control rather than a general redirect rule.

What changed

AI Crawl Control gained a toggle that returns 301 redirects to verified AI training crawlers when a page declares a different canonical URL.

Why it matters

This is a practical control for how AI training systems ingest the web. It gives publishers a way to reduce duplicate training fetches and reinforce canonical content without changing the human browsing experience.

Evidence excerpt

Cloudflare says verified AI training crawlers requesting a page with a canonical tag pointing elsewhere now receive a 301 redirect to the canonical version while humans and AI search agents continue to see the original page.

Sources