Browse Source

Block SEOkicks bot from crawling the site

merge-requests/88/head
Deimos 5 years ago
parent
commit
0a52c0dc49
  1. 4
      tildes/static/robots.txt

4
tildes/static/robots.txt

@ -51,6 +51,10 @@ Disallow: /
User-agent: SemrushBot-BA
Disallow: /
# https://www.seokicks.de/robot.html
User-agent: SEOkicks
Disallow: /
# https://serpstatbot.com/
User-agent: serpstatbot
Disallow: /

Loading…
Cancel
Save