Docs
Search docs...⌘K

Crawled pages

API + MCP
GET/v3/site-explorer/crawled-pages

Query parameters

selectstringRequired

A comma-separated list of fields to return.

order_bystring

A field to order the results by, with optional direction. Format: field_name:asc or field_name:desc (default desc).

wherestring

Supported fields:

limitinteger

The number of results to return.

Default:1000
protocolstring

The protocol of your target.

Allowed values:bothhttphttps
Default:both
modestring

The scope of the search based on the target you entered.

Allowed values:exactprefixdomainsubdomains
Default:subdomains
targetstring (url)Required

The target of the search: a domain or a URL.

outputstring

The output format.

Allowed values:jsoncsvxmlphp

Responses

pagesarray<object>
first_seenstring (date-time)

The timestamp when the URL was first seen by Ahrefs.

http_codeinteger

The HTTP status code returned when the page was last crawled.

last_attemptstring (date-time)

The timestamp of the last crawl attempt.

last_crawledstring (date-time)

The timestamp of the last successful crawl.

titlestring or null

The page's meta title.

urlstring (url)

The URL of the crawled page.

url_ratingnumber (float)

URL Rating of the page at the time of the last crawl, on a 100-point scale.