Skip Navigation
How to block AI Crawler Bots using robots.txt file
  • Wow. A lot of cynicism here. The AI bots are (currently) honoring robots.txt so this is an easy way to say go away. Honeypot urls can be a second line of defense as well as blocking published IP ranges. They’re no different than other bots that have existed for years.

  • [OC] In Iceland this week and found this

    Not an amazing pic but thought I’d share.

    4
    InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)5O
    5opn0o30 @lemmy.world
    Posts 1
    Comments 25