I shared a link from NPR Tiny Desk but there was no image preview or video embed. After investigating this I learned that when you do that, each instance picks up the link and individually retrieves the link preview nearly simultaneously. For gargantuan sites like YT or Reddit, this is a trivial amount of traffic and not a problem, but for smaller sites like NPR this results in a sort of botnet DDOS attack on the site’s servers. More here.. For that reason, NPR has blocked Fediverse servers like Mastodon.

I have experienced this on my personal server as well (DDOS), but at the time didn’t know why, exactly.

This isn’t the end of the world, but certainly is not great and hurts engagement with the content. Is there a solution for this? Perhaps using some sort of webtorrent service like PeerTube where they just fetch the information from another fediverse server instead of the source server? Maybe fetching embeds client-side? At least that would stagger the requests.

  • artyom@piefed.socialOP
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    That’s not at all the same thing. That’s just the inability to handle large amounts of unexpected normal user traffic.

    This is essentially bot traffic driven by servers all independently but simultaneously fetching the same image, without even a single human necessarily looking at it.

    • INeedMana@piefed.zip
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      From server’s perspective the only difference between those is the user-agent. Traffic is the same

        • INeedMana@piefed.zip
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          Yes, but then a comment mentioned the “hug of death” - high spike of requests resulting from a link being shared on some site, and OP asked why centralized sites were also creating problems

          There was another post regarding previews some months/(knowing me probably a year) ago and personally I would go with federating previews. With a button for mods to refresh it from source for when something goes fucky

          But social networks have been creating random bursts of requests, this way or another, even in the times of centralized socials

      • artyom@piefed.socialOP
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        The origin and purpose of the traffic is not the same. That’s why they block one and not the other.