AI agents that visit websites
Each agent below was checked against its operator's documentation, where one exists. They are grouped by what a visit means for your business, from the ones that bring people to the ones that only collect data.
Assistants acting for a person
Each one fetches a page because someone asked an AI assistant a question right now. Each visit is a person waiting for an answer that may mention you.
- ChatGPT-User OpenAI
- Claude-User Anthropic
- Perplexity-User Perplexity
- Meta-ExternalFetcher Meta
- DuckAssistBot DuckDuckGo
- MistralAI-User Mistral AI
Agentic browsers
Each one navigates, clicks and fills in forms in a browser on behalf of a person, for example to compare offers or book something.
- ChatGPT agent OpenAI
- Google-Agent Google
AI search crawlers
Each one builds the index an AI assistant searches when it answers. If it cannot read your pages, the assistant cannot cite or recommend them.
- OAI-SearchBot OpenAI
- Claude-SearchBot Anthropic
- PerplexityBot Perplexity
- Meta-WebIndexer Meta
- Amazonbot Amazon
- PetalBot Huawei
AI training crawlers
Each one collects pages that may be used to train AI models. A visit does not answer anyone right now; it decides what future models know about you.
- GPTBot OpenAI
- ClaudeBot Anthropic
- Google-Extended Google
- Applebot-Extended Apple
- Meta-ExternalAgent Meta
- CCBot Common Crawl
- Bytespider ByteDance
Search engines
Each one indexes pages for a search engine, whose results also feed AI answers.
Link preview fetchers
Each one loads a page to show its preview when a link is shared in a chat or social network.
- FacebookExternalHit Meta
Ads checkers
Each one checks landing pages submitted as ads.
- OAI-AdsBot OpenAI
Which of them visit your site?
See in seconds how your site treats these agents. Then connect your traffic to see who came, what they read and how many people they sent.
The same list as JSON: api.knocklog.ai/v1/agents