punchline!

AdIdxBot

Checks pages for an advertising productPublished addressesReverse DNS

AdIdxBot is Microsoft's crawler for checking landing pages and ad content for its advertising products.

Should you let it in?

Allow or block AdIdxBot

Yes, if you advertise with Microsoft: it checks your landing pages for its ad products.

To ask it to stay out, add this to robots.txt. Whether it follows robots.txt is Microsoft's call; its documentation says.

User-agent: AdIdxBot
Disallow: /

Is it really?

How to tell a real AdIdxBot from an impostor

Anyone can put “AdIdxBot” in a user agent. What can't be faked:

  • Check the address. Microsoft publishes the IP ranges AdIdxBot uses: www.bing.com/toolbox/bingbot.json. A request whose user agent says AdIdxBot from an address outside them is an impostor.
  • Check reverse DNS. Look up the requesting IP's host name; it should end in search.msn.com. Then look that name up and make sure it resolves back to the same IP, since anyone can set a reverse DNS name on their own addresses.

In Punchline

How Punchline counts AdIdxBot

Punchline labels a request that names AdIdxBot with how sure it is: verified or declared when the evidence checks out, a lower tier when it can't be checked, and impostor when the evidence contradicts it. Each visit is counted under Microsoft, with its purpose, so you can see whether AdIdxBot is reading your site and which pages it reads. How it works · Known agents

See whether AdIdxBot reads your site