Trapping misbehaving bots in an AI Labyrinth
blog.cloudflare.com
How Cloudflare uses generative AI to slow down, confuse, and waste the resources of AI Crawlers and other bots that don’t respect “no crawl” directives.
  • jlow (he/him)@beehaw.orgEnglish
    6·
    11 days ago

    Not sure if throwing resource-wasting technology at a resource-wasting problem is a cool idea on an already burning planet …

    • Possibly linux@lemmy.zipEnglish
      3·
      11 days ago

      Honestly we need a proof of work web standard. There should be an optional proof a work that a server can require. From there you could have products and services that detect the bot and force a proof of work.

  • draughtcyclist@lemmy.worldEnglish
    41·
    11 days ago

    This is amazing. The number of crawlers that don’t respect crawling directives is out of hand. Feed them garbage till they can’t pay their bills.