AI agent directory
Who's reading your site? A field guide.
Every AI crawler and agent Punchline recognizes by name: who runs it, why it fetches, and how to check a request really is it. Generated from the registry Punchline's classifier uses, so it's exactly what we detect.
- Agents and crawlers
- 60
- Operators
- 36
- You can prove are real
- 30
Why it visits
How to prove it's real
60 of 60 agents
- Amzn-UserAmazon Fetches for a person asking nowName only
Amzn-User - BingPreviewMicrosoft Fetches for a person asking nowReverse DNS
BingPreview - ChatGPT-UserOpenAI Fetches for a person asking nowPublished addresses
ChatGPT-User - Claude-UserAnthropic Fetches for a person asking nowPublished addresses
Claude-User - DuckAssistBotDuckDuckGo Fetches for a person asking nowPublished addresses
DuckAssistBot - facebookexternalhitMeta Fetches for a person asking nowName only
facebookexternalhit - FeedFetcher-GoogleGoogle Fetches for a person asking nowPublished addressesReverse DNS
FeedFetcher-Google - Google-CloudVertexBotGoogle Fetches for a person asking nowPublished addressesReverse DNS
Google-CloudVertexBot - meta-externalfetcherMeta Fetches for a person asking nowName only
meta-externalfetcher - MistralAI-UserMistral AI Fetches for a person asking nowPublished addresses
MistralAI-User - Perplexity-UserPerplexity Fetches for a person asking nowPublished addresses
Perplexity-User - ChatGPT agentOpenAI Acts in a browser for a personSigned requests
signs its requests - Claude-AgentAnthropic Acts in a browser for a personPublished addresses
Claude-Agent - Google-AgentGoogle Acts in a browser for a personPublished addresses
Google-Agent - AhrefsBotAhrefs Builds a search or answer indexPublished addressesReverse DNS
AhrefsBot - AmazonbotAmazon Builds a search or answer indexReverse DNS
Amazonbot - Amzn-SearchBotAmazon Builds a search or answer indexName only
Amzn-SearchBot - ApplebotApple Builds a search or answer indexPublished addressesReverse DNS
Applebot - BaiduspiderBaidu Builds a search or answer indexReverse DNS
Baiduspider - BarkrowlerBabbar Builds a search or answer indexName only
Barkrowler - BingbotMicrosoft Builds a search or answer indexPublished addressesReverse DNS
bingbot - BLEXBotWebMeUp Builds a search or answer indexName only
BLEXBot - Claude-SearchBotAnthropic Builds a search or answer indexPublished addresses
Claude-SearchBot - DataForSeoBotDataForSEO Builds a search or answer indexName only
DataForSeoBot - DiffbotDiffbot Builds a search or answer indexName only
Diffbot - DuckDuckBotDuckDuckGo Builds a search or answer indexPublished addresses
DuckDuckBot - GooglebotGoogle Builds a search or answer indexPublished addressesReverse DNS
Googlebot - ImagesiftBotImageSift (Hive) Builds a search or answer indexName only
ImagesiftBot - meta-webindexerMeta Builds a search or answer indexName only
meta-webindexer - MistralAI-IndexMistral AI Builds a search or answer indexPublished addresses
MistralAI-Index - MJ12botMajestic Builds a search or answer indexName only
MJ12bot - MojeekBotMojeek Builds a search or answer indexName only
MojeekBot - OAI-SearchBotOpenAI Builds a search or answer indexPublished addresses
OAI-SearchBot - PerplexityBotPerplexity Builds a search or answer indexPublished addresses
PerplexityBot - PetalBotHuawei Builds a search or answer indexName only
PetalBot - QwantbotQwant Builds a search or answer indexName only
Qwantbot - rogerbotMoz Builds a search or answer indexName only
rogerbot - SemrushBotSemrush Builds a search or answer indexName only
SemrushBot - serpstatbotSerpstat Builds a search or answer indexName only
serpstatbot - SeznamBotSeznam Builds a search or answer indexName only
SeznamBot - SlurpYahoo Builds a search or answer indexReverse DNS
Slurp - SogouSogou Builds a search or answer indexName only
Sogou - TimpibotTimpi Builds a search or answer indexName only
Timpibot - YandexBotYandex Builds a search or answer indexReverse DNS
YandexBot - YetiNaver Builds a search or answer indexName only
Yeti - YouBotYou.com Builds a search or answer indexName only
YouBot - AI2BotAi2 (Allen Institute for AI) Collects training dataName only
AI2Bot - BytespiderByteDance Collects training dataName only
Bytespider - CCBotCommon Crawl Collects training dataPublished addresses
CCBot - ClaudeBotAnthropic Collects training dataPublished addresses
ClaudeBot - cohere-aiCohere Collects training dataName only
cohere-ai - FacebookBotMeta Collects training dataName only
FacebookBot - GPTBotOpenAI Collects training dataPublished addresses
GPTBot - meta-externalagentMeta Collects training dataName only
meta-externalagent - MistralAI-TrainingMistral AI Collects training dataName only
MistralAI-Training - WebzioWebz.io Collects training dataName only
Webzio - AdIdxBotMicrosoft Checks pages for an advertising productPublished addressesReverse DNS
AdIdxBot - AdsBot-GoogleGoogle Checks pages for an advertising productPublished addressesReverse DNS
AdsBot-Google - meta-externaladsMeta Checks pages for an advertising productName only
meta-externalads - OAI-AdsBotOpenAI Checks pages for an advertising productPublished addresses
OAI-AdsBot
Use it
Take the list with you
The same list as JSON, with user-agent patterns, IP range lists, reverse DNS suffixes and signature key directories: /agents.json. Registry version 2026-11-16.2.
Agents that aren't on this list are still detected, by behavior: HTTP clients, headless and automated browsers, cloud networks and machine-like request rates. See Concepts.