Browse Source

Block MauiBot from crawling the site

I have no idea what this bot is for, the only thing in its UA is a gmail
address.
merge-requests/64/head
Deimos 6 years ago
parent
commit
73497a4060
  1. 3
      tildes/static/robots.txt

3
tildes/static/robots.txt

@ -3,3 +3,6 @@ Disallow: /
User-agent: dotbot User-agent: dotbot
Disallow: / Disallow: /
User-agent: MauiBot
Disallow: /
Loading…
Cancel
Save