CloudflareBrowserRenderingCrawler
Cloudflare's scraper.
- Operator
- Cloudflare
- Type
- Scraper
- In the user agent
CloudflareBrowserRenderingCrawler- robots.txt token
- none
- Follows robots.txt
- does not say whether it follows robots.txt
- Official documentation
- developers.cloudflare.com
- Checked on
- 2026-11-11
What is CloudflareBrowserRenderingCrawler?
CloudflareBrowserRenderingCrawler is Cloudflare's scraper. It collects data for a product that is not an AI assistant.
The operator's description: Crawl endpoint of Cloudflare's browser product, run by Cloudflare customers against third-party sites.
(developers.cloudflare.com)
How do I block or allow CloudflareBrowserRenderingCrawler?
CloudflareBrowserRenderingCrawler has no robots.txt token of its own. Cloudflare does not say whether it follows robots.txt. Controlling its access means recognising its verified identity at the edge (CDN or server).
How do I see whether CloudflareBrowserRenderingCrawler visits my site?
In your server or CDN access logs, look for CloudflareBrowserRenderingCrawler in the user agent. Google Analytics does not show these visits: agents do not run its JavaScript.
Anyone can copy the name in a user agent, so counting log lines is not enough. Knocklog reads your site's traffic on any host, confirms who is who, and shows how often CloudflareBrowserRenderingCrawler came, which pages it read and what that brought you.
How do I know it is really CloudflareBrowserRenderingCrawler?
Cloudflare does not publish a way to verify CloudflareBrowserRenderingCrawler. Any program can use that name, so Knocklog shows these visits as “unverified”, never as genuine.
Does CloudflareBrowserRenderingCrawler visit your site?
See in seconds how your site treats AI agents. Then connect your traffic to learn who really came.
Other Cloudflare agents
- Cloudflare-AI-Search AI search crawler