21 lines
341 B
Plaintext
21 lines
341 B
Plaintext
User-agent: DuckDuckBot
|
|
Disallow: /cursors/
|
|
Disallow: /images/
|
|
Disallow: /fonts/
|
|
Disallow: /moderator/
|
|
Disallow: /login
|
|
Disallow: /logout
|
|
Disallow: /human/
|
|
|
|
User-agent: Yahoo! Slurp
|
|
Disallow: /cursors/
|
|
Disallow: /images/
|
|
Disallow: /fonts/
|
|
Disallow: /moderator/
|
|
Disallow: /login
|
|
Disallow: /logout
|
|
Disallow: /human/
|
|
|
|
User-agent: *
|
|
Disallow: /
|