BOT DIRECTORY

Known bots and crawlers

Identity reference coverage for AI crawlers, search bots, SEO crawlers, social bots, monitoring agents, and other automated traffic recognised by RequestIntel.

Search bots or organisationsCategory

Bot	Organisation	Category	Verification	Status
AhrefsBot	Ahrefs	SEO crawler	Identification only	active
Amazonbot	Amazon	AI crawler	Identification only	active
Amzn-SearchBot	Amazon	Search crawler	Identification only	active
Amzn-User	Amazon	AI crawler	Identification only	active
Claude-User	Anthropic	AI crawler	Identification only	active
ClaudeBot	Anthropic	AI crawler	Identification only	active
Applebot	Apple	Search crawler	Independent verification available	active
iTMS	Apple	Other bot	Identification only	active
Baiduspider	Baidu	Search crawler	Identification only	active
Better Uptime Bot	Better Uptime	Monitoring bot	Identification only	active
CensysInspect	Censys	Security scanner	Identification only	active
CCBot	Common Crawl	AI crawler	Independent verification available	active
DataForSeoBot	DataForSEO	SEO crawler	Identification only	active
Datadog Synthetics	Datadog	Monitoring bot	Identification only	active
Discordbot	Discord	Social bot	Independent verification available	active
DuckDuckBot	DuckDuckGo	Search crawler	Identification only	active
AdsBot-Google	Google	Search crawler	Independent verification available	active
Google-CloudVertexBot	Google	AI crawler	Identification only	active
Google-InspectionTool	Google	Other bot	Independent verification available	active
GoogleOther	Google	AI crawler	Identification only	active
GoogleOther-Image	Google	AI crawler	Identification only	active
GoogleOther-Video	Google	AI crawler	Identification only	active
Googlebot	Google	Search crawler	Independent verification available	active
Googlebot-Image	Google	Search crawler	Independent verification available	active
Googlebot-Video	Google	Search crawler	Independent verification available	active
Mediapartners-Google	Google	Search crawler	Independent verification available	active
Storebot-Google	Google	Search crawler	Independent verification available	active
PetalBot	Huawei	Search crawler	Identification only	active
LinkedInBot	LinkedIn	Social bot	Identification only	active
MJ12bot	Majestic	SEO crawler	Identification only	active
facebookexternalhit	Meta	Social bot	Identification only	active
adidxbot	Microsoft	Search crawler	Identification only	active
bingbot	Microsoft	Search crawler	Independent verification available	active
DotBot	Moz	SEO crawler	Identification only	active
ChatGPT-User	OpenAI	AI crawler	Independent verification available	active
GPTBot	OpenAI	AI crawler	Independent verification available	active
OAI-SearchBot	OpenAI	AI crawler	Independent verification available	active
Perplexity-User	Perplexity	AI crawler	Independent verification available	active
PerplexityBot	Perplexity	AI crawler	Independent verification available	active
Pingdom	Pingdom	Monitoring bot	Identification only	active
Pinterestbot	Pinterest	Social bot	Independent verification available	active
SEOkicks-Robot	SEOkicks	SEO crawler	Identification only	active
SISTRIX Crawler	SISTRIX	SEO crawler	Identification only	active
SemrushBot	Semrush	SEO crawler	Identification only	active
Site24x7	Site24x7	Monitoring bot	Identification only	active
Slackbot-LinkExpanding	Slack	Social bot	Identification only	active
StatusCake	StatusCake	Monitoring bot	Identification only	active
UptimeRobot	UptimeRobot	Monitoring bot	Identification only	active
BLEXBot	WebMeUp	SEO crawler	Identification only	active
YandexBot	Yandex	Search crawler	Independent verification available	active