Disallow GPTBot to access your site
Disallow GPTBot to access your site
platform.openai.com
OpenAI Platform
13 comments
-
Or don't do anything. There are plenty of crawlers out there and disallowing won't stop the unethical ones.
-
Just because some people might break into my house doesn't mean I'll stop locking my doors.
-
that doesn't lock anything, it's not a security feature.
-
A house door lock isn’t that much about security either.
-
It's a deterrent. Which is a pretty apt comparison for robots.txt and user agent blocking.
-
-
-
-
That is the point. They don’t need to be secure to work as a deterrent
-
-
-
13 comments