• isleepinahammock@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    1
    ·
    22 hours ago

    No computer program can go beyond what it is programmed to do. Computers cannot think, they can only follow the code.

    Fire cannot think either. It follows a very predictable kind of behavior. It spreads and grows to new sources of fuel and oxygen.

    A fire can still burn out of control.

    • just2look@piefed.social
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      3
      ·
      20 hours ago

      That isn’t a good analogy. We have absolute control over every aspect of the program, the environment it runs in, and the hardware it runs on. We can’t even force computers to do anything actually random. The best we can do is approximate randomness.

      • wewbull@feddit.uk
        link
        fedilink
        English
        arrow-up
        1
        ·
        5 hours ago

        You’re right, but think back to things like the “worms” of old. Their program specified their behaviour precisely, but no-one could predict their spread. We’re placing random instruction generators inside harnesses which loop and execute their instructions. The range of possible outcomes is almost anything.

        Honestly the thought of running agentic harnesses with no safety guards is one of the most stupid ideas I’ve seen. Orders of magnitude more than curl | sh.

        • just2look@piefed.social
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 hours ago

          No one anthropomorphized malware like this though. The worms didn’t go rogue. And people didn’t see the damage done and decide there should be no consequences and the best course of action was to give billions of dollars to the person who built the worm.