mirror of
https://github.com/mastodon/mastodon.git
synced 2024-11-24 23:01:20 +00:00
Disallow robots from indexing /interact/ (#10666)
This does not provide any new information and may just triple the number of crawled pages
This commit is contained in:
parent
0db269f3dc
commit
c4f2433300
|
@ -2,3 +2,4 @@
|
|||
|
||||
User-agent: *
|
||||
Disallow: /media_proxy/
|
||||
Disallow: /interact/
|
||||
|
|
Loading…
Reference in a new issue