Knocklog

How to see which AI agents visit my website

ChatGPT, Claude, Perplexity and Gemini read websites all the time, but those visits do not show up in Google Analytics. Here is where they are and how to tell which ones are real.

Why Google Analytics does not show AI agents

Google Analytics and similar tools only count a visit when the browser runs their JavaScript. AI agents and crawlers almost never run that script: they request the page from the server, read the text and leave. That is why AI traffic does not show up in your dashboard, even when it is large.

Where the visits show up

Every visit goes through your site's server or CDN. Access logs record the user agent of each request, and that is where names such as ChatGPT-User, GPTBot, ClaudeBot and PerplexityBot appear. If your site uses Cloudflare, its dashboard also shows the AI crawlers it recognises.

On shared hosting (cPanel and similar), the logs are under “Raw Access” in the control panel.

The agents that matter most
AgentOperatorType
ChatGPT-UserOpenAIAssistant acting for a person
OAI-SearchBotOpenAIAI search crawler
GPTBotOpenAIAI training crawler
Claude-UserAnthropicAssistant acting for a person
Claude-SearchBotAnthropicAI search crawler
ClaudeBotAnthropicAI training crawler
Perplexity-UserPerplexityAssistant acting for a person
PerplexityBotPerplexityAI search crawler
Google-ExtendedGoogleAI training crawler
Meta-ExternalAgentMetaAI training crawler

A name in the user agent is not proof

Any program can say it is GPTBot. To know whether a visit really comes from the agent, check its IP address against the ranges the operator publishes, its reverse DNS or its cryptographic signature (Web Bot Auth). Without that, you count impostors as if they were ChatGPT.

Not every visit is worth the same

A training crawler collects pages for future models. An AI search crawler builds the index the assistant searches. An assistant acting for a person fetches the page because someone asked something right now. That last one is the closest to a customer, so tell the kinds apart before deciding what to block.

How to measure what agents bring you

Knocklog reads your site's traffic on any host (Cloudflare, cPanel, WordPress, Next.js, your own server or imported logs), verifies each agent's identity and shows which pages they read, how many people the assistants sent to your site and, on the Business plan, which companies visited. The check is free and needs no sign-up.

Start with the free check

Enter your site's address to see how it treats AI agents and what to fix.

Full list: 26 AI agents