punchline!

Google-CloudVertexBot

Fetches for a person asking nowPublished addressesReverse DNS

Google-CloudVertexBot fetches pages when a person using Google's assistant asks something that needs them, so a visit means someone is asking about the page right now.

Should you let it in?

Allow or block Google-CloudVertexBot

Usually, yes. Each visit is a person asking Google's assistant something your page answers, right now. Blocking it means the answer is written without your page.

To ask it to stay out, add this to robots.txt. Whether it follows robots.txt is Google's call; its documentation says.

User-agent: Google-CloudVertexBot
Disallow: /

Is it really?

How to tell a real Google-CloudVertexBot from an impostor

Anyone can put “Google-CloudVertexBot” in a user agent. What can't be faked:

  • Check the address. Google publishes the IP ranges Google-CloudVertexBot uses: developers.google.com/static/crawling/ipranges/special-crawlers.json. A request whose user agent says Google-CloudVertexBot from an address outside them is an impostor.
  • Check reverse DNS. Look up the requesting IP's host name; it should end in googlebot.com or google.com. Then look that name up and make sure it resolves back to the same IP, since anyone can set a reverse DNS name on their own addresses.

In Punchline

How Punchline counts Google-CloudVertexBot

Punchline labels a request that names Google-CloudVertexBot with how sure it is: verified or declared when the evidence checks out, a lower tier when it can't be checked, and impostor when the evidence contradicts it. Each visit is counted under Google, with its purpose, so you can see whether Google-CloudVertexBot is bringing people's questions to your pages and which pages it reads. How it works · Known agents

See whether Google-CloudVertexBot reads your site