fedi/mastodon
1
0
Fork 1
mirror of https://github.com/mastodon/mastodon.git synced 2024-12-24 18:05:24 +00:00
Code Issues Packages Projects Releases Wiki Activity

block all robots in robots.txt (#1)

Browse source
This commit is contained in:
Nolan Lawson 2017-04-08 16:20:24 -07:00
parent fbcbf7898f
commit 7a2db7a396
1 changed files with 1 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
public/robots.txt
View file

@ -1,5 +1,2 @@
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
User-agent: *
Disallow: /media_proxy/
Disallow: /interact/
Disallow: /