oldkid
|
c87296d520
|
add User-Agent: SummalyBot https://datadome.co/bots/summalybot/
|
2025-05-11 07:56:49 +02:00 |
|
oldkid
|
cd007b2db8
|
update
|
2025-04-26 07:01:53 +02:00 |
|
oldkid
|
6afb7dc2b0
|
update ai.robots.txt
add robots.txt
add apache-badbots.conf
|
2025-04-26 06:57:32 +02:00 |
|
oldkid
|
bcb0414008
|
Merge branch 'refs/heads/main' into develop
|
2025-04-24 15:10:56 +02:00 |
|
oldkid
|
27d4434cfa
|
README.md aktualisiert
|
2025-04-24 13:10:16 +00:00 |
|
oldkid
|
021b6603ee
|
LICENSE aktualisiert
|
2025-04-24 13:09:10 +00:00 |
|
oldkid
|
7dd717dd49
|
Update 20250424
Source hinzugefügt
|
2025-04-24 14:45:00 +02:00 |
|
oldkid
|
2d64cef6e0
|
Update 20250424
Source hinzugefügt
|
2025-04-24 14:44:23 +02:00 |
|
oldkid
|
7567dd74f3
|
Bots and Crawler aktualisiert
add :
AI2Bot
Ai2Bot-Dolma
Brightbot
CCBot
ChatGPT-User
cohere-ai
cohere-training-data-crawler
Crawlspace
Diffbot
FriendlyCrawler
Google-Extended
GoogleOther
GoogleOther-Image
GoogleOther-Video
iaskspider
ICC-Crawler
ImagesiftBot
img2dataset
ISSCyberRiskCrawler
KangarooBot
OAI-SearchBot
omgili
omgilibot
PanguBot
Perplexity-User
PetalBot
Scrapy
SemrushBot-OCOB
SemrushBot-SWA
Sidetradeindexerbot
Timpibot
VelenPublicWebCrawler
Webzio-Extended
YouBot
|
2025-03-30 08:05:31 +00:00 |
|
oldkid
|
12c65f8188
|
add
BLEXBot
Barkrowler
|
2025-03-28 13:39:17 +01:00 |
|
oldkid
|
14bd344a70
|
Bots and Crawler hinzugefügt
|
2025-03-26 13:55:12 +00:00 |
|
oldkid
|
e0b3f4ea5f
|
Initial commit
|
2025-03-26 13:38:39 +00:00 |
|