Blocked_Bots_and_Crawler_Se.../Bots and Crawler
2025-03-26 13:55:12 +00:00

41 lines
549 B
Text

Livelapbot
Franck, the Fediverse Graph Crawler
YisouSpider
DotBot
VelenPublicWebCrawler
ChatGPT-User
GoogleOther
GoogleOther-Image
GoogleOther-Video
Applebot
Applebot-Extended
AhrefsBot
Baiduspider
SemrushBot
DotBot
MJ12bot
PetalBot
SeznamBot
Mediapartners-Google
Bytespider
Claude-Web
GPTBot
PerplexityBot
Applebot
Amazonbot
Meta-ExternalAgent
Meta-ExternalFetcher
FacebookBot
DuckAssistBot
Anthropic-ai
Bytespider
Bytedance
fidget-spinner-bot
EmailCollector
WebEMailExtrac
ClaudeBot
facebookexternalhit
facebookcatalog
YandexBot
Bingbot
Googlebot