PostText/public/robots.txt

21 lines
341 B
Plaintext
Raw Normal View History

2023-08-25 17:25:49 +00:00
User-agent: DuckDuckBot
Disallow: /cursors/
Disallow: /images/
Disallow: /fonts/
Disallow: /moderator/
Disallow: /login
Disallow: /logout
Disallow: /human/
User-agent: Yahoo! Slurp
Disallow: /cursors/
Disallow: /images/
Disallow: /fonts/
Disallow: /moderator/
Disallow: /login
Disallow: /logout
Disallow: /human/
User-agent: *
2023-08-15 04:39:22 +00:00
Disallow: /