What is Bot Analytics
Bot Analytics ingests HTTP request data from your infrastructure and provides insights into bot behavior across your websites or apps.
Getting started
To start using Bot Analytics, you need to connect a data source that sends request logs to Ahrefs. Choose the installation method that matches your infrastructure:
- Cloudflare — Connect via Logpush (Enterprise plan) or a Worker (any plan).
- Vercel — Connect via the Ahrefs Vercel integration (Pro and Enterprise plans).
- Amazon CloudFront — Send CloudFront access logs to Ahrefs through an Amazon Data Firehose stream in your AWS account.
- AWS Application Load Balancer — Send load balancer access logs to Ahrefs through an Amazon Data Firehose stream in your AWS account.
- Fastly — Stream your service's request logs to Ahrefs with a Fastly HTTPS logging endpoint.
info
More data sources are coming soon. Check back for updates.
What Ahrefs receives
Every installation method sends Ahrefs a log line for each request to your site, from browsers as well as bots. Ahrefs keeps the bot requests and discards the rest. Your Cloudflare, Vercel, AWS or Fastly configuration does not filter out browsers.
For redirects, Ahrefs also records the Location response header where the source can send it: the Cloudflare Worker and Logpush, Fastly, and redirects answered by an AWS Application Load Balancer listener rule. Vercel and Amazon CloudFront logs do not include response headers, so their redirects show only the status code.
Sending every request can count toward quotas or add charges on your provider's side. Each installation guide lists the limits and costs that apply to it.
Setting up
All installation is done from your Ahrefs project settings:
- Go to Project Settings → Bot Analytics for your project.
- Select an installation method.
- Either use automatic setup by providing an API token, follow the manual setup instructions, authorize the Ahrefs integration (Vercel), or configure the delivery in your own provider account (Amazon CloudFront, Fastly).
See the individual installation guides for detailed steps.