Should we block OpenAI from scrapping the server?
Should we block OpenAI from scrapping the server?
Right now, robots.txt on lemmy.ca is configured this way
undefined
User-Agent: * Disallow: /login Disallow: /login_reset Disallow: /settings Disallow: /create_community Disallow: /create_post Disallow: /create_private_message Disallow: /inbox Disallow: /setup Disallow: /admin Disallow: /password_change Disallow: /search/ Disallow: /modlog
Would it be a good idea privacy-wise to deny GPTBot from scrapping content from the server?
undefined
User-agent: GPTBot Disallow: /
Thanks!