Sekretaerbaer-Netz/Blocked_Bots_and_Crawler_Sekretaerbaer.de
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

add MojeekBot https://www.mojeek.com/bot.html

Browse source
This commit is contained in:
oldkid 2025-05-11 08:45:42 +02:00
parent c87296d520
commit 8b4f3bfb63
4 changed files with 4 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

1
robots.txt
View file

@ -71,6 +71,7 @@ User-agent: Googlebot
User-agent: Livelapbot
User-agent: Mediapartners-Google
User-agent: MJ12bot
User-agent: MojeekBot
User-agent: SemrushBot
User-agent: SeznamBot
User-Agent: SummalyBot