BOT DIRECTORY

Known bots and crawlers

See which bots and crawlers RequestIntel recognises, who runs them, and whether they can be verified.
Check a crawler request →
BotOrganisationCategoryVerification
AhrefsBotAhrefsSEO crawlerCan be verified
AmazonbotAmazonAI crawlerCan be verified
Amzn-SearchBotAmazonSearch crawlerCan be verified
Amzn-UserAmazonAI crawlerCan be verified
ClaudeBotAnthropicAI crawlerCan be verified
Claude-SearchBotAnthropicAI crawlerCan be verified
Claude-UserAnthropicAI crawlerCan be verified
ApplebotAppleSearch crawlerCan be verified
iTMSAppleOther botCan be verified
BaiduspiderBaiduSearch crawlerCan be verified
Better Uptime BotBetter UptimeMonitoring botCan be verified
BytespiderByteDanceAI crawlerIdentification only
CensysInspectCensysSecurity scannerCan be verified
CCBotCommon CrawlAI crawlerCan be verified
Datadog SyntheticsDatadogMonitoring botCan be verified
DataForSeoBotDataForSEOSEO crawlerCan be verified
DiscordbotDiscordSocial botCan be verified
DuckAssistBotDuckDuckGoAI crawlerCan be verified
DuckDuckBotDuckDuckGoSearch crawlerCan be verified
AdsBot-GoogleGoogleSearch crawlerCan be verified