Sam Altman:
A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we’re going to be able to run them on our computers, and so we’re not going to need all the stuff in the data center.
But from a global allocation perspective, actually it’s quite terrible to have everybody, like, have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used five percent of the time.
Like you want maximum utilisation in the cloud if you’re trying to deal with this very supply-constrained environment,
And somehow many people’s intuition is the opposite of that
TL;DR Guy selling product: “Here’s why owning your own product instead of renting it from me is a terrible idea”
This clearly staged photo op is a interesting choice. I can see how it’s meant to humanize Sam, and portray him as a common, ordinary person. But why does it looks like someone just gave him a compliment and made him flustered?
ハチロク ハチロク ハチロク ハチロク ハチロク ハチロク
Guy selling product: “Here’s why owning your own product instead of renting it from me is a terrible idea”
Guy with the spying infrastructure in place to steal your product when renting his product, says you escaping his ability to spy is waste of resources.
Personal computers are a ridiculous idea, you should use our scalable mainframes instead --IBM in the 80s, probably
There was famously a guy who’s said that the world needs like five or so computers. But that was when each computer took a whole room.
There’s certainly nothing enjoyable to do on an AS400
Pissing on an AS400 is kinda fun, especially if it’s running and not backed up
Just be careful not to piss on any high-voltage components.
As someone that makes use of an AS400 (well i series), I can confirm that there is no fun to be had.
I haven’t seen the real thing in almost 30 years, but the company I work for uses the emulation and it has no noticeable improvements.
Crazy as it is. you can still get the (slightly modernized) hardware. IBM just makes too much money to stop supporting it.
Wow, that’s awful
I bet he owns a car that gets less than 5% usage.
Having billionaires is a terrible allocation of scarce resources, don’t you find?
I bet he had literally never touched a bus.
I came here to say exactly this!
Change the word DRAM to car and see how ridiculous this sounds. And I’m a big supporter of public transit.
Shovel seller vehemently against you building your own shovel
Oh BROTHER this does this guy suck!
They are both telling us we will have a culture of abundance while also telling us RAM is too sacred for any of us plebes to own any.
I don’t think anyone should, but if Sam gets to then it should be fair game for everyone because fuck him.
yeah my computer with all it’s computing power is turned off most of the time
and so is pretty much everything I own except my phone
He’s technically not wrong, but FUCK YOU for screwing up the market.
It’s also un-optimized to have cars vs busses, non-single payer healthcare, to have citizen gun owners, and anything other than pure socialism…
He is technically wrong though. His argument is based on people only using DRAM for model inference. Which is nuts.
People use DRAM for a lot of things more beneficial than AI inference. And those use cases are also many times more efficient than whatever this Epstein class guy is using it for.
A CNC machine that produces actual goods that are actually beneficial to humanity does need DRAM. I doubt it needs more than 100MB though. An LLM counting the RS in strawberry eats up a gazillion TB of DRAM to produce nothing of value.
Sounds like a problem for the sharing economy: kinda like you’re able to do https://foldingathome.org/
I’m sure someone will come up with a solution that lets you rent out excess capacity from your gpu cluster.
Wouldn’t that end up like the crypto mining market? Mostly big players due to economies of scale, with hobbyists struggling to break even.
I think it might - but no idea honestly haha
I was envisioning it’s bit more like Airbnb where you rent out your capacity when you have excess.
“sindy swindy shouldn’t go out with that guy he’s all yucky and gross” says CEO of the “sindy should be blowing ME” corp. in answer to a question on whether he’d ever score, he assured the news dolts that he’s gonna score, any day now
“Raping your own siblings at home is terribly inefficient when we have private islands where we can keep and rape other people’s siblings.”
“OpenRape automates your raping needs in efficient and industrialized format. Our rapecenters will be built around the country to support the growing number of rape requests. We train our rape agents on real life input (wars etc.). You can be sure they never go rogue (unless we prompt them to).”
Molotovs are also a scarce resource, I think we need to throw as many as we can at Sam Altman.
