redstrate/redstrate.com
1
Fork 0
Code Activity Actions

Fix robots.txt

Browse source
This commit is contained in:
Joshua Goins 2023-09-07 14:03:51 -04:00
parent e7624fcebf
commit 9dbdfb7bd2
2 changed files with 7 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
themes/red/layouts/robots.txt
View file

@ -3,3 +3,9 @@ Disallow: /
User-agent: Mediapartners-Google
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /

5
themes/retro/layouts/robots.txt
View file

@ -1,5 +1,2 @@
User-agent: CCBot
Disallow: /
User-agent: Mediapartners-Google
User-agent: *
Disallow: /