• Björn Tantau
    link
    fedilink
    1212 days ago

    It would be nice if it was possible to describe perfectly what a program is supposed to do.

  • @[email protected]
    link
    fedilink
    91 day ago

    I wrote a shell script like this (it admin , notna dev) for private use.
    The prompt took me like 5 hours of rewriting the instructions.
    Don’t even know yet if it works (lol)

  • kn0wmad1c
    link
    fedilink
    English
    -82 days ago

    Calling GPT a neural network is pretty generous. It’s more like a markov chain

    • @[email protected]
      link
      fedilink
      42 days ago

      I’ve played with markov chains. They don’t create serious results, ever. ChatGPT is right just often enough for people to think it’s right all the time.

    • @[email protected]
      link
      fedilink
      English
      32 days ago

      The core language model isn’t a nueral network? I agree that the full application is more Markov chainy but I had no idea the LLM wasn’t.

      Now I’m wondering if there are any models that are actual neutral networks

      • kn0wmad1c
        link
        fedilink
        English
        -42 days ago

        I’m not an expert. I’d just expect a neural network to follow the core principle of self-improvement. GPT is fundamentally unable to do this. The way it “learns” is closer to the same tech behind predictive text in your phone.

        It’s the reason why it can’t understand why telling you to put glue on pizza is a bad idea.

        • lime!
          link
          fedilink
          English
          62 days ago

          the main thing is that the system end-users interact with is static. it’s a snapshot of all the weights of the “neurons” at a particular point in the training process. you can keep training from that snapshot for every conversation, but nobody does that live because the result wouldn’t be useful. it needs to be cleaned up first. so it learns nothing from you, but it could.

        • @[email protected]
          link
          fedilink
          2
          edit-2
          2 days ago

          “Improvement” is an open ended term. Would having longer or shorter toes be beneficial? Depends on the evolutionary environment.

          ChatGPT does have a feedback loop. Every prompt you give it affects its internal state. That’s why it won’t give you the same response next time you give the same prompt. Will it be better or worse? Depends on what you want.