I’m not sure if I just thought this up sitting on the tiles in my shower room or if I dreamt it, but still.

Edit: I’m being cynical and I hate our blind faith in and reliance on LLMs.

    • klankin@piefed.ca
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      I think thats OPs point, Ai doesn’t provide answers, it provides confidence.

      So when they get it wrong 99% of the time, it doesn’t actually matter cause we decided pleasing stakeholders is equivalent to actual success.

    • Rhynoplaz@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      1 month ago

      That depends on if the AI was programmed to calculate or not. Clearly an LLM is not, but there are other forms of AI that are.

      • hoshikarakitaridia@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        1 month ago

        This makes no sense.

        Neural networks inherently work in a probabilistic latent space. The whole point is that we have a definable problem and we are unable to apply any deterministic mathematical calculations to it. That’s why we call it a “black box problem” - we know what the solution looks like and we have a few examples of input and output data, but we don’t know what the method looks like. In fact, even if we have an AI we don’t know what the method looks like. If you wanna know more about this issue, look up explainable AI and you will find all the ways we have tried to come up with smart solutions like model heat maps to estimate their methodology. But these are all approximations.

        Now if you ask an LLM what method it used to get to a solution, it will try to work backwards using its own reasoning and context clues to give you what its best estimation of the methodology is but that’s not the same as its true methodology.

        For me (and most people of the machine learning field I am aware of) an AI is inherently worse at calculations. That’s what algorithms are for. And the only things sitting somewhere between an LLM and an algorithm are maybe Markov chains and randomforest. If there’s anything remotely close to an AI model that is good at calculations, I am all ears.

        • webghost0101@sopuli.xyz
          link
          fedilink
          arrow-up
          0
          ·
          1 month ago

          I think your being a little to zoom in on the technicalities of modern day ai to tell the trees from the forest.

          I am a bundle of connected neurons, effectively a neural network, i can calculate just fine.

          Humans are “in general” horrible at doing math but thats besides the point of being capable of it.

          Modern humans have a calculator in their pocket and we use it as a tool to make our own conclusions. Like ways “current day” ai often has acces to a calculator tool to do the same. Sure this is not ai doing the actual math but in practice its the same as a human with a calculator.

          But the topic at hand is not even about current day ai but about hypotethical future ai that “somehow” is trusted enough to pull the plug on machines that keep a sick human alive.

          Such future ai. If it would ever exist would have acces to such tools, possibly more complex tools to calculate odds of survival using (hopefully) a formula with a great number of input variables to consider all kinds of situations.

          I would imagine such to be a known formula that humans could also independantly measure and calculate ending in a % chance of a survival. But somehow in this hypothetical future this would be a job given to ai.

          So the question is less can ai solve math and more can we trust ai to interptet humam measuring tools to then put those values in a known formula tool to then act appropriatly on the results of said tool, and not at any point misalign/hallucinate.

          • hoshikarakitaridia@lemmy.world
            link
            fedilink
            arrow-up
            0
            ·
            1 month ago

            Ok but then why call it AI?

            We don’t have to dream about a distant future to find a thing that can do math for us. It’s called a computer, and if it’s in our home, it might even be a personal computer. In fact, we have them smaller and faster, and they have fancy designs and can communicate to the world but it turns out they got a small chip inside that does a bunch of arithmetic binary operations and then a lot of them also have a chip inside them that can quickly operate on huge matrices of values. We call those cpus and gpus respectively.

            What I’m saying is, if it’s just a threshold of different values, we were capable of making such a machine already, even before AI. And if it’s an interpretative opinion, it turns out AI is notoriously bad at those.

            So the only thing an AI actually helps with is to do something when we don’t know how. But the issue was never how. Now there’s something to be said about the predictability of death but there’s an insane amount of compounding factors that contribute to this. An AI could maybe be trained on a subset of factors but the truth is, we don’t have good input and output data, that’s why AI won’t help us here.

            I’m not saying this to be pedantic, I’m making a point: even IF we decide that actually ethically it’s fine for a machine to decide when someone has to die - which is quite a big leap - even then an AI won’t be better than a human, so there’s no point. And there’s no way to make this look good, no way to sell this to the broader populus. I just don’t see any way where this scenario is possible, let alone probable.

            And I think that’s important, because it’s very easy to slide down this slippery slope, interpolate a time series forecast in our head and essentially conclude “it’s going downhill so the future must be what our average dystopia predicted” and I don’t think that’s right or even helpful. There’s quite a few things we should improve and our world is on the brink of a bigger societal change again, but change is never just bad. Change is an opportunity to improve the things that are important to us. And to do this, we need all the brilliant minds that see those issues to imagine those improvements, so we should make sure we know what needs to be done when we finally get the chance.

            • jet@hackertalks.com
              link
              fedilink
              English
              arrow-up
              0
              ·
              1 month ago

              Off topic- reading your comments today have been the highlight, really well done, thank you for contributing an increasing the discourse

            • printf("%s", name);@piefed.blahaj.zoneOP
              link
              fedilink
              English
              arrow-up
              0
              ·
              1 month ago

              And I think that’s important, because it’s very easy to slide down this slippery slope, interpolate a time series forecast in our head and essentially conclude “it’s going downhill so the future must be what our average dystopia predicted” and I don’t think that’s right or even helpful. There’s quite a few things we should improve and our world is on the brink of a bigger societal change again, but change is never just bad. Change is an opportunity to improve the things that are important to us. And to do this, we need all the brilliant minds that see those issues to imagine those improvements, so we should make sure we know what needs to be done when we finally get the chance.

              This is really beautiful. I just wish capitalism didn’t stand in the way of science, medicine and altruism.

          • klankin@piefed.ca
            link
            fedilink
            English
            arrow-up
            0
            ·
            1 month ago

            Thats really funny that your way for an AI to solve a problem is have something else solve the problem then claim ownership.

            Like would it not be simpler in almost all cases to just use the tool directly?

            Otherwise youre introducing an intentionally difficult to quantify number of errors.

            • webghost0101@sopuli.xyz
              link
              fedilink
              arrow-up
              0
              ·
              1 month ago

              Spoken like a peasant capable of critical thought.

              The corporate overlords who want to replace humans with ai don’t like workers who can think for themselves, they have zero interests in building better tools for humans.

              They dream of robot slaves who keep them unaccountable for any “accidents”

  • Rhynoplaz@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    1 month ago

    But what if it had calculated that this person who will remain vegetative for the rest of their life, had healthy organs that could be used immediately to save 10 lives?

    • klankin@piefed.ca
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      You think that can be accurately encoded in a text predictor?

      Like sure eventually computers will be powerful enough to Turing machine an LLM into something useful - a la monkeys on typewriters. But the efficiency of such a system is compatible to natural selection in its probability distribution. When a Dr 40 years ago could have given you the same, and actually describe why without taking another 2^256 years to compute.

      • Rhynoplaz@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        1 month ago

        I really don’t understand why everyone thinks that chatbots and image generators are the only form of AI out there. AI has been around for decades longer than chatbots. Industrial AI isnt designed to chat. It’s designed to work.

        • klankin@piefed.ca
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          Yeah but in a post about LLMs I think the context clues kinda enforce what AI algorithm is being discussed.

          I suppose it is only mentioned in the edit of OP, but still

          • Rhynoplaz@lemmy.world
            link
            fedilink
            arrow-up
            0
            ·
            1 month ago

            I thought the spirit of the discussion was ethics of allowing machines to make medical decisions. Which, I think is a valid philosophical discussion that needs to happen soon, because the technology is quickly going to put us there.

            Using a digital Magic 8 ball to make those decisions is just nonsense, and there’s nothing to discuss.

            • klankin@piefed.ca
              link
              fedilink
              English
              arrow-up
              0
              ·
              1 month ago

              You got me there not gonna lie.

              I think I have a hard time seeing technological/ethical/philosphical as new cause most of it is just a change in order of magnitude over old mathematical/ethical/philosophical debates, but that is my own bias. Honestly I feel like comparing AI models is closer to that stupid Nazi “skull measuring” bs than a generalisable framework for the universe.

              On the medical ethical side, I’d trust a computer to make decisions that require that processing order of magnitude (or sampling frequency/sampling method) - but again I feel like we were already accepting this back in the 40s with early digital sensors, and even more so in the 90s on with microchips.

              But I wouldn’t trust them on emotional decisions and interpretation, cause why try to approximate some then when real humans exist.

              So TLDR my hot take is Drs have for a while been human machine translator/therapists, which ends up being a pretty damn technical job.

      • Rhynoplaz@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        1 month ago

        It would take a lot of the emotional pressure off of the doctors and family member who do have to make the call. It’s a lot easier to blame a machine than to blame yourself.

        • klankin@piefed.ca
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          I vote we should start flipping a coin for all decisions ever, to take the emotional pressure off everyone and blame the coin.

          Cause I stg I’d kill god himself before we treat healthcare workers like humans, the only reasonable solution is the coin.

        • fluffy_cloud@piefed.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          Disregard Rhynoplaz, he’s a troll. He’ll say a bunch of baseless, inflammatory stuff and then fail to back it up. Just block the fool.

    • borinque808@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      1 month ago

      What if it had? Do you think that makes it acceptable for the AI to decide to pull the plug (as per the OP’s scenario)?

      • Rhynoplaz@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        1 month ago

        Are you going to be the one to tell those other ten people’s families that their loved one is going to die because another family wants to watch their brain dead Uncle breathe for a few more weeks?

        • borinque808@lemmy.world
          link
          fedilink
          arrow-up
          0
          ·
          1 month ago

          Actually, the conversation usually goes something like this:

          Patient/family: do you have a kidney yet?

          Doctor: no, not yet

          (no mention of the family dealing with a difficult, personal decision about their loved one)

          The larger question being presented is who gets to decide whether to pull the plug? Do you want such a decision about your spouse or child to be in the hands of another?

          • Rhynoplaz@lemmy.world
            link
            fedilink
            arrow-up
            0
            ·
            1 month ago

            Forgive my theatrics, just trying to put you in the mindset of 10 people that died because your human brain chose to state at a vegetable. No, probably not even that. They’ll keep him on life support and go back to their own lives. And more and more people will die as he lays there alone and unaware.

            Human emotion makes lots of bad decisions.

  • username_1@discuss.tchncs.de
    link
    fedilink
    arrow-up
    0
    ·
    1 month ago

    Blind faith? Reliance? Those exist only in anti-LLM fanatics’ proclamations. Specialists who can use LLMs just… well… use it to save some time and effort where possible.

      • username_1@discuss.tchncs.de
        link
        fedilink
        arrow-up
        0
        ·
        1 month ago

        You can start with licensing books usage. Imagine, now every idiot can open a book and read some crazy shit and nobody is going to stop that! Some people even learn reading outside specialized facilities! Outrageous!

    • klankin@piefed.ca
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      My favourite dystopian theories are always the ones it turns out america has already been doing for 150 years.

      Like the torment nexus ain’t just inspirational, its systemically foundational.