# AhrefsBot

> AhrefsBot is Ahrefs's crawler for building the index its search and answers draw on. Here's how to recognize it and check a request really is it.

## AhrefsBot facts

- **Operator:** Ahrefs
- **Type:** Crawler
- **Why it fetches:** Builds a search or answer index
- **User agent contains:** `AhrefsBot`, `AhrefsSiteAudit`
- **Verified by:** published IP ranges, reverse DNS
- **Operator's documentation:** [ahrefs.com/robot](https://ahrefs.com/robot)

## Allow or block AhrefsBot

Yes, if you want to appear in Ahrefs's search and answers. Blocking it can keep your pages out of them.

To ask it to stay out, add this to robots.txt: `User-agent: AhrefsBot` then `Disallow: /`. Whether it follows robots.txt is Ahrefs's call; [its documentation](https://ahrefs.com/robot) says.

## How to tell a real AhrefsBot from an impostor

Anyone can put "AhrefsBot" in a user agent. What can't be faked is below.

- **Check the address.** Ahrefs publishes the IP ranges AhrefsBot uses: [api.ahrefs.com/v3/public/crawler-ip-ranges](https://api.ahrefs.com/v3/public/crawler-ip-ranges). A request whose user agent says AhrefsBot from an address outside them is an impostor.
- **Check reverse DNS.** Look up the requesting IP's host name; it should end in `ahrefs.com` or `ahrefs.net`. Then look that name up and make sure it resolves back to the same IP, since anyone can set a reverse DNS name on their own addresses.

## How Punchline counts AhrefsBot

Punchline labels a request that names AhrefsBot with how sure it is: **verified** or **declared** when the evidence checks out, a lower tier when it can't be checked, and **impostor** when the evidence contradicts it. Each visit is counted under Ahrefs, with its purpose, so you can see whether AhrefsBot is reading your site and which pages it reads. [How it works](https://punchlineanalytics.com/how-it-works) · [Known agents](https://punchlineanalytics.com/docs/agents)

[See which agents read your site](https://app.punchlineanalytics.com/signup)
