swaggboi/PostText
1
0
Fork 0
Code Issues Pull requests Packages Projects Releases Wiki Activity

Allow Marginalia search

Browse source
This commit is contained in:
swaggboi 2024-08-06 14:08:05 -04:00
parent e02d839cde
commit fc46e4e958
1 changed files with 9 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

9
public/robots.txt
View file

@ -1,3 +1,12 @@
User-agent: search.marginalia.nu
Disallow: /cursors/
Disallow: /images/
Disallow: /fonts/
Disallow: /moderator/
Disallow: /login
Disallow: /logout
Disallow: /human/
User-agent: DuckDuckBot User-agent: DuckDuckBot
Disallow: /cursors/ Disallow: /cursors/
Disallow: /images/ Disallow: /images/