Cloudflare Logpush

Cloudflare Logpush sends HTTP request logs to Ahrefs automatically. It is the recommended method for high-traffic sites, but requires a Cloudflare Enterprise plan.

Prerequisites

• A Cloudflare Enterprise plan on the zone you want to monitor.
• A Cloudflare API token with the following permissions:
  • Zone → Zone → Read
  • Zone → Logs → Edit

Obtaining Cloudflare API token

Make sure you are logged in to the Cloudflare Dashboard with the correct account. Then navigate to the https://dash.cloudflare.com/profile/api-tokens page, locate and click the Create Token button in the top right:

Now proceed with the Create Custom Token flow:

Fill in the following information:

• API token name: ahrefs-bot-analytics
• Grant the following permissions:
  • Zone / Logs / Edit so we can configure a Logpush job to push logs to Ahrefs Bot Analytics
  • Zone / Zone / Read so we can locate the zone to configure
• Zone Resources can be set to Include / All Zones, alternatively select the Zone which corresponds to your website's domain.

Now click the Continue to summary button, the summary should look like this:

Now click the Create Token button and copy the generated token to the clipboard to use in the next steps.

See the Cloudflare documentation on how to create an API token for additional information.

Automatic setup

1. In Ahrefs, go to Project Settings → Bot Analytics.
2. Select Cloudflare Logpush as the method.
3. Paste your Cloudflare API token and click Connect.

Ahrefs will use your token to:

1. Find the zone matching your project's domain.
2. Check for existing Logpush jobs.
3. Create a new job that sends logs to Ahrefs.

Manual setup

If you prefer not to provide an API token, you can set up the Logpush job manually using the Cloudflare API.

Step 1 — Get your Zone ID and API token

1. Go to your Cloudflare dashboard and select your website's domain.

2. In the right sidebar, scroll down to the API section to find your Zone ID.

3. Click "Get your API token" and create a new token with the following permissions:

   • Zone → Zone → Read
   • Zone → Logs → Edit

   See Obtaining API token for detailed instructions.

Step 2 — Create the Logpush job

Once you have your $ZONE_ID and $CF_TOKEN, run the following command. You can find the exact command pre-filled with your project's details in Project Settings → Bot Analytics → Set up manually.

curl "https://api.cloudflare.com/client/v4/zones/$ZONE_ID/logpush/jobs" \
  -X POST \
  -H "Authorization: Bearer $CF_TOKEN" \
  --data-binary '{
  "name": "ahrefs-web-analytics-http-requests",
  "destination_conf": "https://analytics.ahrefs.com/api/cf_logpush/http_requests?header_x-ahrefs-web-analytics-property=YOUR_PROPERTY_KEY",
  "dataset": "http_requests",
  "frequency": "high",
  "filter": "{\"where\":{\"or\":[{\"key\":\"ClientRequestHost\",\"operator\":\"eq\",\"value\":\"yourwebsite.com\"},{\"key\":\"ClientRequestHost\",\"operator\":\"endsWith\",\"value\":\".yourwebsite.com\"}]}}",
  "output_options": {
    "field_names": [
      "ClientIP", "ClientRequestMethod", "ClientRequestHost",
      "ClientRequestProtocol", "ClientRequestScheme", "ClientRequestURI",
      "ClientRequestPath", "ClientRequestUserAgent", "ClientRequestReferer",
      "EdgeStartTimestamp", "EdgeEndTimestamp", "EdgeResponseStatus",
      "EdgeResponseBytes", "EdgeResponseContentType",
      "EdgeTimeToFirstByteMs", "ClientCountry", "ClientCity", "ClientASN",
      "ClientDeviceType", "ClientRegionCode", "BotScore", "BotScoreSrc",
      "BotTags", "VerifiedBotCategory", "RayID"
    ],
    "timestamp_format": "unixnano"
  },
  "enabled": true
}'

Step 3 — Verify the connection

After creating the job, go back to Project Settings → Bot Analytics in Ahrefs and click Check status to verify that data is being received.