redstrate/redstrate.com
1
Fork 0
Code Activity Actions

Add more to robots.txt

Browse source
This commit is contained in:
Joshua Goins 2023-09-29 11:47:45 -04:00
parent 63b8b86b8c
commit e055c6edc4
1 changed files with 9 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

9
themes/red/layouts/robots.txt
View file

@ -9,3 +9,12 @@ Disallow: /
User-agent: ChatGPT-User User-agent: ChatGPT-User
Disallow: / Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: Omgilibot
Disallow: /
User-agent: FacebookBot
Disallow: /