oldkid
|
e67d06107b
|
add QualifiedBot
|
2025-05-18 07:29:05 +02:00 |
|
oldkid
|
ca3882e587
|
Merge branch 'refs/heads/develop'
|
2025-05-18 05:57:54 +02:00 |
|
oldkid
|
1e79324675
|
add QualifiedBot
|
2025-05-18 05:57:13 +02:00 |
|
oldkid
|
2dcff05d5e
|
Merge branch 'refs/heads/develop'
add MojeekBot https://www.mojeek.com/bot.html
|
2025-05-11 08:46:33 +02:00 |
|
oldkid
|
8b4f3bfb63
|
add MojeekBot https://www.mojeek.com/bot.html
|
2025-05-11 08:45:42 +02:00 |
|
oldkid
|
99e4a6aa2a
|
Merge branch 'refs/heads/develop'
add User-Agent: SummalyBot https://datadome.co/bots/summalybot/
|
2025-05-11 08:08:30 +02:00 |
|
oldkid
|
c87296d520
|
add User-Agent: SummalyBot https://datadome.co/bots/summalybot/
|
2025-05-11 07:56:49 +02:00 |
|
oldkid
|
05ffe319d9
|
Merge branch 'refs/heads/develop'
|
2025-04-26 07:02:43 +02:00 |
|
oldkid
|
cd007b2db8
|
update
|
2025-04-26 07:01:53 +02:00 |
|
oldkid
|
2bb3d4c9c9
|
Merge branch 'refs/heads/develop'
update ai.robots.txt
add robots.txt
add apache-badbots.conf
|
2025-04-26 06:58:32 +02:00 |
|
oldkid
|
6afb7dc2b0
|
update ai.robots.txt
add robots.txt
add apache-badbots.conf
|
2025-04-26 06:57:32 +02:00 |
|
oldkid
|
bcb0414008
|
Merge branch 'refs/heads/main' into develop
|
2025-04-24 15:10:56 +02:00 |
|
oldkid
|
27d4434cfa
|
README.md aktualisiert
|
2025-04-24 13:10:16 +00:00 |
|
oldkid
|
021b6603ee
|
LICENSE aktualisiert
|
2025-04-24 13:09:10 +00:00 |
|
oldkid
|
7dd717dd49
|
Update 20250424
Source hinzugefügt
|
2025-04-24 14:45:00 +02:00 |
|
oldkid
|
2d64cef6e0
|
Update 20250424
Source hinzugefügt
|
2025-04-24 14:44:23 +02:00 |
|
oldkid
|
7567dd74f3
|
Bots and Crawler aktualisiert
add :
AI2Bot
Ai2Bot-Dolma
Brightbot
CCBot
ChatGPT-User
cohere-ai
cohere-training-data-crawler
Crawlspace
Diffbot
FriendlyCrawler
Google-Extended
GoogleOther
GoogleOther-Image
GoogleOther-Video
iaskspider
ICC-Crawler
ImagesiftBot
img2dataset
ISSCyberRiskCrawler
KangarooBot
OAI-SearchBot
omgili
omgilibot
PanguBot
Perplexity-User
PetalBot
Scrapy
SemrushBot-OCOB
SemrushBot-SWA
Sidetradeindexerbot
Timpibot
VelenPublicWebCrawler
Webzio-Extended
YouBot
|
2025-03-30 08:05:31 +00:00 |
|
oldkid
|
12c65f8188
|
add
BLEXBot
Barkrowler
|
2025-03-28 13:39:17 +01:00 |
|
oldkid
|
14bd344a70
|
Bots and Crawler hinzugefügt
|
2025-03-26 13:55:12 +00:00 |
|
oldkid
|
e0b3f4ea5f
|
Initial commit
|
2025-03-26 13:38:39 +00:00 |
|