OpenAI, the folks behind ChatGPT, have published information on its web crawler named GPTBot. You can now see if OpenAI is crawling your site, how much so, and you can disallow access to all or part of your site with the robots.txt protocol.
from Search Engine Roundtable https://ift.tt/qgbjli3
No comments:
Post a Comment
Leave Post