ShapBot
Parallel Web Systems's AI search crawler.
- Operator
- Parallel Web Systems
- In the user agent
ShapBot- robots.txt token
ShapBot- Follows robots.txt
- says it follows robots.txt
- Official documentation
- parallel.ai
- Checked on
- 2026-11-17
What is ShapBot?
ShapBot is Parallel Web Systems's AI search crawler. It builds the index an AI assistant searches when it answers. If it cannot read your pages, the assistant cannot cite or recommend them.
The operator's description: Crawls public pages for Parallel's web search index, which AI agents query through its API.
(parallel.ai)
How do I block or allow ShapBot?
With robots.txt, using the token ShapBot. Parallel Web Systems says it follows robots.txt. To block the whole site:
User-agent: ShapBot
Disallow: /
To allow it, use Allow instead of Disallow. Before blocking, weigh what it brings: without it, the assistant cannot find your pages to cite or recommend them.
How do I see whether ShapBot visits my site?
In your server or CDN access logs, look for ShapBot in the user agent. Google Analytics does not show these visits: agents do not run its JavaScript.
Anyone can copy the name in a user agent, so counting log lines is not enough. Knocklog reads your site's traffic on any host, confirms who is who, and shows how often ShapBot came, which pages it read and what that brought you.
How do I know it is really ShapBot?
Parallel Web Systems signs ShapBot requests with Web Bot Auth (HTTP message signatures, RFC 9421) from https://shapbot.parallel.ai. A valid signature is the strongest proof of identity.
Parallel Web Systems publishes ShapBot's IP addresses at https://docs.parallel.ai/resources/shapbot.json. A visit that claims to be ShapBot from outside those ranges is spoofed.
Knocklog runs this check on every visit and separates the genuine agent from impostors.
Does ShapBot visit your site?
See in seconds how your site treats AI agents. Then connect your traffic to learn who really came.
Other Parallel Web Systems agents
- Shap-User Assistant acting for a person