Disallow GPTBot to access your site
Disallow GPTBot to access your site
platform.openai.com OpenAI Platform
Explore developer resources, tutorials, API docs, and dynamic examples to get the most out of OpenAI's platform.
You're viewing a single thread.
13
comments
Or don't do anything. There are plenty of crawlers out there and disallowing won't stop the unethical ones.
Just because some people might break into my house doesn't mean I'll stop locking my doors.
that doesn't lock anything, it's not a security feature.
A house door lock isn’t that much about security either.
It's a deterrent. Which is a pretty apt comparison for robots.txt and user agent blocking.
If you knew how pointless door locks are you might think different.
That is the point. They don’t need to be secure to work as a deterrent
You've viewed 13 comments.