punchline!

meta-externalagent

Collects training dataName only

meta-externalagent is Meta's crawler for collecting pages that may be used to train AI models.

Should you let it in?

Allow or block meta-externalagent

Your call. Blocking it keeps new pages out of the training data this crawler collects. Operators often answer live questions with a different agent (see the others from Meta below), so you can block one and keep the other.

To ask it to stay out, add this to robots.txt. Whether it follows robots.txt is Meta's call; its documentation says.

User-agent: meta-externalagent
Disallow: /

Is it really?

How to tell a real meta-externalagent from an impostor

Anyone can put “meta-externalagent” in a user agent. What can't be faked:

  • Its operator doesn't publish a way to verify it, so a request claiming to be it can only be treated as a claim.

In Punchline

How Punchline counts meta-externalagent

Punchline labels a request that names meta-externalagent with how sure it is: verified or declared when the evidence checks out, a lower tier when it can't be checked, and impostor when the evidence contradicts it. Each visit is counted under Meta, with its purpose, so you can see whether meta-externalagent is reading your site and which pages it reads. How it works · Known agents

See whether meta-externalagent reads your site