• sudo@programming.dev
    link
    fedilink
    English
    arrow-up
    16
    ·
    edit-2
    1 day ago

    The problem is primarily the resource drain on the server and tarpitting tactics usually increase that resource burden by maintaining the open connections.

    • SorteKanin@feddit.dk
      link
      fedilink
      English
      arrow-up
      3
      ·
      10 hours ago

      The idea is that eventually they would stop scraping you cause the data is bad or huge. But it’s a long term thing, it doesn’t help in the moment.

      • Monument@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        2
        ·
        6 hours ago

        The promise of money — even diminishing returns — is too great. There’s a new scraper spending big on resources every day while websites are under assault.

        In the paraphrased words of the finance industry: AI can stay stupid longer than most websites can stay solvent.