1. 15
    Exterminate all rational AI scrapers ai jwz.org
    laktak avatar via laktak 2 months ago |
    Archive.org Archive.today Ghostarchive
    | 7 comments

  1.  

    1. 6
      sny avatar sny 2 months ago

      This reminds me of the “world’s lamest content farm”:

      As I think I have mentioned before, I have the world’s lamest content farm at https://www.web.sp.am/. Click on a link or two and you’ll get the idea.
      Unfortunately, GPTBot has found it and has not gotten the idea. It has fetched over 3 million pages today.

      1. 3
        carlana avatar carlana 2 months ago

        When Heroku had a free tier, I had a honeypot on it that was just an endless stream of Markov chain text based on a book by AA Milne (this was a few years before Winnie the Pooh went into the public domain). I wonder what the GPTs do when you ask them questions about that book…

        1. 2
          5d22b avatar 5d22b 2 months ago

          Similar recent submission: https://lobste.rs/s/s9yq5a/block_ai_scrapers_with_anubis

          1. 2
            5d22b avatar 5d22b 2 months ago

            Similar recent submission: https://lobste.rs/s/rhsupf/nepenthes_tarpit_intended_catch_web

            1. 1
              symgryph avatar symgryph 2 months ago

              How do I actually implement this? Is there a nice how-to or a repo of some kind?

              1. 3
                laktak avatar laktak 2 months ago

                There’s a link to DadaDodo so I guess it’s not much different from https://www.jwz.org/dadadodo/dadadodo.cgi

                1. 2
                  friendlysock avatar friendlysock 2 months ago

                  I imagine you could ask Claude or ChatGPT and get a reasonable starting point, lol.

              🇬🇧 The UK geoblock is lifted, hopefully permanently.