AhrefsSiteAudit
Ahrefs's scraper.
- Operator
- Ahrefs
- Type
- Scraper
- In the user agent
AhrefsSiteAudit- robots.txt token
AhrefsSiteAudit- Follows robots.txt
- says it follows robots.txt only in part
- Official documentation
- ahrefs.com
- Checked on
- 2026-11-11
What is AhrefsSiteAudit?
AhrefsSiteAudit is Ahrefs's scraper. It collects data for a product that is not an AI assistant.
The operator's description: Runs Ahrefs Site Audit; obeys robots.txt unless the verified site owner turns that off.
(ahrefs.com)
How do I block or allow AhrefsSiteAudit?
With robots.txt, using the token AhrefsSiteAudit. Ahrefs says it follows robots.txt only in part. To block the whole site:
User-agent: AhrefsSiteAudit
Disallow: /To allow it, use Allow instead of Disallow. Before blocking, weigh what it brings: look at how often it visits and what it brings before deciding.
How do I see whether AhrefsSiteAudit visits my site?
In your server or CDN access logs, look for AhrefsSiteAudit in the user agent. Google Analytics does not show these visits: agents do not run its JavaScript.
Anyone can copy the name in a user agent, so counting log lines is not enough. Knocklog reads your site's traffic on any host, confirms who is who, and shows how often AhrefsSiteAudit came, which pages it read and what that brought you.
How do I know it is really AhrefsSiteAudit?
Ahrefs publishes AhrefsSiteAudit's IP addresses at https://api.ahrefs.com/v3/public/crawler-ip-ranges. A visit that claims to be AhrefsSiteAudit from outside those ranges is spoofed.
The IP's reverse DNS, confirmed forward and back, must end in .ahrefs.com or .ahrefs.net.
Knocklog runs this check on every visit and separates the genuine agent from impostors.
Does AhrefsSiteAudit visit your site?
See in seconds how your site treats AI agents. Then connect your traffic to learn who really came.
Other Ahrefs agents
- AhrefsBot Scraper