specter/mastodon
1
0
Fork 0
forked from fedi/mastodon
Code Pull requests Activity

Change: Block GPTBot (#26396)

Browse source
This commit is contained in:
Foritus 2023-08-09 10:58:46 +01:00 committed by GitHub
parent 2c88364222
commit 405f141fe0
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 3 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
public/robots.txt
View file

@ -1,5 +1,8 @@
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
User-agent: GPTBot
Disallow: /
User-agent: * User-agent: *
Disallow: /media_proxy/ Disallow: /media_proxy/
Disallow: /interact/ Disallow: /interact/