# DataForSeoBot

> DataForSeoBot is DataForSEO's crawler for building the index its search and answers draw on. Here's how to recognize it and check a request really is it.

## DataForSeoBot facts

- **Operator:** DataForSEO
- **Type:** Crawler
- **Why it fetches:** Builds a search or answer index
- **User agent contains:** `DataForSeoBot`
- **Verified by:** not verifiable
- **Operator's documentation:** [dataforseo.com/dataforseo-bot](https://dataforseo.com/dataforseo-bot)

## Allow or block DataForSeoBot

Yes, if you want to appear in DataForSEO's search and answers. Blocking it can keep your pages out of them.

To ask it to stay out, add this to robots.txt: `User-agent: DataForSeoBot` then `Disallow: /`. Whether it follows robots.txt is DataForSEO's call; [its documentation](https://dataforseo.com/dataforseo-bot) says.

## How to tell a real DataForSeoBot from an impostor

Anyone can put "DataForSeoBot" in a user agent. What can't be faked is below.

- Its operator doesn't publish a way to verify it, so a request claiming to be it can only be treated as a claim.

## How Punchline counts DataForSeoBot

Punchline labels a request that names DataForSeoBot with how sure it is: **verified** or **declared** when the evidence checks out, a lower tier when it can't be checked, and **impostor** when the evidence contradicts it. Each visit is counted under DataForSEO, with its purpose, so you can see whether DataForSeoBot is reading your site and which pages it reads. [How it works](https://punchlineanalytics.com/how-it-works) · [Known agents](https://punchlineanalytics.com/docs/agents)

[See which agents read your site](https://app.punchlineanalytics.com/signup)
