Saw Wendell do this on the latest GN video and for some reason just knew it needed to be a thing.

    • xbloodymajor@reddthat.com
      link
      fedilink
      English
      arrow-up
      0
      ·
      26 days ago

      I like to think of it like solar panels. Sure at first it takes a lot to make, but over time it evens out. I was pretty clear local AI is still morally grey at best, but its a real solution to some problems, an I would argue its better to have local control and use small energy efficient models to do assisting tasks than let the open AI’s of the world decide for us.

      • nixos_fan@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        6 days ago

        It’s strange to think selfhosted models are systematically more efficient than cloud hosted ones, have you never heard of economy of scale? Of batching?