Sekretaerbaer-Netz/Blocked_Bots_and_Crawler_Sekretaerbaer.de
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Bots and Crawler hinzugefügt

Browse source
This commit is contained in:
oldkid 2025-03-26 13:55:12 +00:00
parent e0b3f4ea5f
commit 14bd344a70
1 changed files with 41 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

41
Bots and Crawler Normal file
View file

@ -0,0 +1,41 @@
Livelapbot
Franck, the Fediverse Graph Crawler
YisouSpider
DotBot
VelenPublicWebCrawler
ChatGPT-User
GoogleOther
GoogleOther-Image
GoogleOther-Video
Applebot
Applebot-Extended
AhrefsBot
Baiduspider
SemrushBot
DotBot
MJ12bot
PetalBot
SeznamBot
Mediapartners-Google
Bytespider
Claude-Web
GPTBot
PerplexityBot
Applebot
Amazonbot
Meta-ExternalAgent
Meta-ExternalFetcher
FacebookBot
DuckAssistBot
Anthropic-ai
Bytespider
Bytedance
fidget-spinner-bot
EmailCollector
WebEMailExtrac
ClaudeBot
facebookexternalhit
facebookcatalog
YandexBot
Bingbot
Googlebot