BOT DIRECTORY

Known bots and crawlers

See which bots and crawlers RequestIntel recognises, who runs them, and whether they can be verified.
Check a crawler request →
BotOrganisationCategoryVerification
Google-AgentGoogleAI crawlerCan be verified
GooglebotGoogleSearch crawlerCan be verified
Googlebot-ImageGoogleSearch crawlerCan be verified
Googlebot-VideoGoogleSearch crawlerCan be verified
Google-CloudVertexBotGoogleAI crawlerCan be verified
Google-GeminiNotebookGoogleAI crawlerIdentification only
Google-InspectionToolGoogleOther botCan be verified
GoogleOtherGoogleAI crawlerCan be verified
GoogleOther-ImageGoogleAI crawlerCan be verified
GoogleOther-VideoGoogleAI crawlerCan be verified
Mediapartners-GoogleGoogleSearch crawlerCan be verified
Storebot-GoogleGoogleSearch crawlerCan be verified
PetalBotHuaweiSearch crawlerIdentification only
LinkedInBotLinkedInSocial botIdentification only
MJ12botMajesticSEO crawlerIdentification only
FacebookBotMetaAI crawlerIdentification only
facebookexternalhitMetaSocial botIdentification only
Meta-ExternalAgentMetaAI crawlerIdentification only
Meta-ExternalFetcherMetaAI crawlerIdentification only
adidxbotMicrosoftSearch crawlerIdentification only