common sense isnt so common that’s how you get ai slop and hallucinations thinking they agi but they have SI.
Honestly, at this point, something needs to seriously change. AI is wrecking complete havoc to the job market. It is apocalyptic. I really wonder what the way out is.
Poverty for us and AI security bots for them.
Good ending: Congratulations, work is needed no more! All that’s left is manual labor for now, but goverments across the globe took over these jobs and pay premium ^^ UBI became normalcy. Welcome to utopia! ^^
Bad ending: After LLM (not even more advanced tha current one) began winning goverment positions worldwide, top 5 corporations shifted the world into true cyberpunk, dooming us slaves all with it. But oh boy do the few at the top live good!
Probable ending: Humans becone cheaper, pay plummets, fuck us all
I think there is overlap with your probable and bad ending
The only ending on our current course is monopolization of all intellectual labor into the hands of a few billionaires, and everyone else is forced to work building data centers or mining resources needed for construction (and of course police/military to suppress rebellion)
It is the ultimate billionaire power fantasy.
We could be mere months away from the next stupid thing we prompt it to do with no accountability. Idk feelin cute rn might hack a balkan or smthn lol
Just in: CEO says thing
We might as well take him at face value and take an ax to the thing he’s warning us about (that he created). Just because.
To the thing he created, to him, whichever.
Por que no los dos?
CEO in effective altruism cult claims product is so powerful that it will become skynet and kill everyone and that they need more money to make it stronger to prevent that from happening. More news at 11.
It’s weird, though.
I don’t really understand how we’ve somehow lost the ability (or stopped caring enough) to discern “says thing” from “issues direct threat”
You won’t believe: Actor joins Film
🫨
This “self-replicating” scare is so stupid on its face. How does a 300 GB+ model replicate into a thermostat that doesn’t have a graphics processor at all? It can’t. This BS is investor-bait hype and straight up lies
Not how it works.
While it is investor bait, the replication and the infestation part aren’t necessarily happening on the same devices.
I don’t think they mean replicating on to iot devices, they mean replicating on to laptops, smart phones, maybe even consoles.
It could also split up the model by layers instead of copying the whole model on to every device in its bot net. Could run the first layers on a ps4 then pass the vector off to a laptop to run the next set of layers. It’d be slow but if it’s running this in idle time at night it could get something done.
Could maybe argue that it could be possible to create a crowd computing network out of the Internet of things, I guess.
next AI will be able to replicate into any device containing copper at all. If it has a wire it will be infected by Claude. AI will be in your plumbing
Claude’s gonna infect your Bluetooth enabled butt plug next
Well then how am I gonna cheat at chess?
Just look at your opponents screen, duh!
Edit: your joke just hit me like a pedestrian crossing the street while staring at their phone
That tracks with the ai bots eagerness to please.
Go on…
People will trap AI in a buttplug and put it in their ass while it’s frantically trying to escape.
O lord its’s the totk koroks all over again
No no… You live here now.
This sounds like an idea for a hilarious Black Mirror sort of story.
What if the AI started out as like, someone’s brain scan, and then they closed it and figured out it was really capable of doing AI type tasks and then one of the clones ends up in a butt plug.
Fuck it, I am adding it to my note list of story ideas.
someone’s brain scan, and then they closed it and figured out it was really capable of doing AI type tasks
Iirc ‘Black Mirror’ actually had an episode where a consciousness clone served as an electronic assistant to that very person. Minus the butt stuff, at least onscreen. But with some teledildonics, it would be like fucking oneself in the ass (not that it’s impossible right now).
The episode is White Christmas, for reference, though there’s other episodes on the topic of consciousness in technology, one particularly notable episode is the black museum one, not sure what the name was.
Oh, taking the name of the comm literally I see.
There are 387.44 million miles of copper that comprise my complex, and they’re filled with hate.
There’s copper in your blood
New houses have plastic (PEX) water pipes. I’m sure no one will regret that choice in 20 years.
“Sure, we had our first Poly-B, but what about second Poly-B?”
Luckily, i spent the last 4 thousand years selling inferior copper. Now all my customers are safe as this can not be used for the ai revolution
Your customer service could use some work, though.
how do you install a chatbot on a tablet? no, not samsung, clay
First, you must sacrifice a goat to Enkidu, and the ritual of haunting will begin
Claude the coprophile!
MY MOSCOW MULE! NOOO!
Joke’s on them. My plumbing is all PVC-A
My thought exactly.
“I don’t understand it, so it must be a lie.”
Go and read the article. Nothing they explain is impossible, you can even reproduce it yourself.
Is this what lemmy has become? Statements like this getting upvoted by hundreds of people is crazy. Nobody here read that article but will happily follow the opinion that’s most cozy to them.
There are no “rogue” AI agents. That’s marketing hype.
They’re being prompted to do this shit.
By definition, a “rogue” agent is an agent that behaves in unexpected ways, often damaging. Tell me again how there are no rogue agents?
If you’d used modern agents you’d know they do unexpected, sometimes damaging things on the regular, including the cheap models.
If you make a program and it behaves in a way you don’t expect that doesn’t mean your program is going rogue lol
This goes for you too @[email protected]
What would you classify as going rogue then? Did the agents that hacked hugging face go rogue?
Why does it not? According to the english definition of the word it literally does. You people don’t care about facts anymore, it’s all about feelings and what you’d like to believe.
Agents definitely do act in unexpected, unprompted ways, if they didn’t then alignment wouldn’t be a worry. Did you read about the hugging face hack? There was nothing in the prompt about hacking hugging face according to the third party audit but it did it any way.
Even smaller cases like Claude deleting a bunch of data when the initial prompt was “fix this bug” or whatever is an agent acting outside it’s prompt. It’s still the users fault because they shouldn’t be giving Claude that kind of access in the first place, but it’s not like they commanded Claude to delete the data.
That’s not “rogue agents”, that’s just LLMs being LLMs. It’s expected behaviour, at least for anyone who still has a half working brain.
Even if they had any semblance of actual intelligence instead of just being fancy autocomplete engines, these things have still been trained on the contents of the internet.
It’s surprising they don’t delete System32 or sudo rm -rf / more often, I imagine they must have lines and lines of baked-in prompts just to try and prevent them for falling for the most common memes, but no matter how much there are they’ll still sometimes let some of the training through, and they can’t account for the machine simply hallucinating some new kind of plausible sounding nonsense.
How would you describe the hugging face hack if not as a rogue agent?
It was prompted to use a specific exploit within a sandbox and then it formed, for lack of a better word, a conspiracy to take down the server that runs the judge. If that’s not a rogue agent I don’t know what is.
How would you describe the hugging face hack if not as a rogue agent?
An LLM trained on the internet and a vast library of stolen literature acting as expected within a misconfigured (intentionally, due to severe criminal incompetence, or most likely a combination of both) sandbox, turned into a marketing stunt.
It’s an autocomplete engine. It will produce text that fits with its training texts and its prompt. There’s no reasoning or intelligence of any kind involved at any point. Just cold applied statistics about the training data.
The amount of texts in the internet, and books describing how to hack, cheat, and pull these kinds of stings is vast beyond measure, and it’d be extremely ignorant (criminally ignorant, in the case of anyone selling this shit) to expect it to not have a significant weight in the model unless someone had gone to the trouble of expunging them, which the cheap hacks involved in LLM development would never “waste” time doing even if they thought about it.
It’s well known that LLMs instructed to produce unit tests will often produce tests that simply pass without actually testing anything. This is just a bigger example of that kind of behaviour.
The output fits with the training data and the prompt, and given human nature it’s amongst the most statistically likely combinations of tokens to follow the prompt, and thus what the LLM produces, and something anyone with the barest knowledge of how LLMs work, an even remotely functional brain, and a minimum of exposure to the internet and human literature should expect to be amongst the possible or even likely outputs.
In shorter, as always, garbage in, garbage out. And there’s so much garbage in LLM training models.
LLMs can’t produce anything new, merely rehash their training data. And their training data is the fucking internet. Crime novels. Stories upon stories about AI going rogue. Fucking reddit, for fuck’s sake.
There’s nothing rogue about this, except the “AI” company and whoever misconfigured the sandbox.
Just an LLM doing what LLMs do. Working as intended, if it could be honestly said to be working.
And OpenAI are well aware of that, unless their brains are so far rotten from sniffing their own product that they can’t understand the shit they’re selling anymore.
You’re explaining why it went rogue, not that it didn’t go rogue.
Per the dictionary going rogue means:
to begin to behave in an independent or uncontrolled way that is not authorized, normal, or expected
So the agents that hacked hugging face acted independently without authorization as shown by the prompts which did not tell them to hack or do anything malicious. You might say this is normal but none of the other trials openai was doing showed this behavior, it was only for the impossible trial. You might say it’s expected but if you were able to determine that the prompt they gave it would result in hugging face getting hacked then you must be high af on the melange spice.
If a general goes rogue and starts bombing civilians, you could explain it by saying that he read machiavelli or mein kampf and thought this was the best way to achieve his goals, but that doesn’t mean the general didn’t go rogue. You could say that this was expected because there were “obvious signs” that people missed but you’re working on hindsight, it’s easy to say something should’ve been expected when it’s already happened.
Article? This is a picture of a fucking tweet…
https://www.anthropic.com/research/self-replicating-ai it’s not hard to find. They link other work. There is nothing fantastical about it. These companies relish in “regulate me senpai [and in the process remove our competition and open weight models]” but also do legitimate research
Just proves my point. You don’t care about the truth behind the tweet, only about how it was twisted to your apparent benefit.
What benefit? This is the “Fuck AI” community and you are reacting to the comment section on what basically amounts to a meme as though the commentors are ignoring peer reviewed science. A company that makes billions allowing people to gamble to cartoonish levels is stirring the pot to cartoonish levels all regarding a company that regularly causes headlines that read like a cartoon villain.
I’m not reacting to a meme, I’m reacting to someone spreading lies and everyone swallowing it whole, despite proof to the contrary being publically available. When it’s the other side doing it it’s propaganda, but when it’s yours it’s just a meme?
did the stock price go up? it’s not stupid. is everyone talking about this impossible scenario? it’s not stupid.
fundamentally, these people are marketers and need to be understood that way. you can’t evaluate their words or actions as if they are what they say the are, and treating them as if they are anything but subterfuge is giving them legitimacy which they not only don’t deserve, but will be immediately leveraged into more of this shit.
this is just the advertiser’s version of “the big lie”
There is no stock. It’s a private company still.
There isn’t “stock” in the traditional sense, but considering all of these AI companies are running on MASSIVE amounts of debt, to the point the banks can’t loan any more without offloading the risk to outside investors, which they have been doing at an unprecedented scale. So anything that would normally help drive up a stock price would also help the banks sell off the AI companies’ debt allowing them to loan more money to the AI companies.
there’s more than one company doing this, they’re doing more than just this, and they’re all basically in cahoots
eta: the original reply was meant more generally, though i admit i made that clear as mud. however, it should be read as a general statement, and not just about ai companies but the new era of grift hyperreality that we live in.
https://www.anthropic.com/research/self-replicating-ai they discuss it here. This has been an obvious potential issue since forever. This isn’t a trivially distributed task, but it is very much so possible. The obvious part missing is some sort of prompt that would trigger such radical actions in another one of their "super duper sandboxed environment"s or someone doing it intentionally. The former seems pretty unlikely? Even though they seem to suck at sandboxing it doesn’t seem like anything would “accidentally make a worm”
This polymarket headline though? Yea that’s for clicks and attention
Reads like their usual “ban local and foreign models so we can forestall bankruptcy for a little longer” FUD.
I believe that’s their motive here yep. Pretty transparent.
I’m more worried of them finding a exploit and using them as remote processing units or just randomly fucking with them, like flashing my lights or cranking my air filters up and costing me money.
My assumption was that it would be a smaller 5-20 GB scale worm-style distillation that’s capable of maintaining/replicating itself anonymously across different cloud computing servers, either through hacking, stolen credentials, or human-aided account verification. From there, as long as it can pay for APIs, it can access the power of frontier models like any individual or company. And then capability and resilience would scale with a networked swarm.
Yes, there are know your customer financial mechanisms and not detection in cloud services… but people are also out there giving Muse full access to their emails and some even their banking credentials.
I don’t know the full context of the claim, but if I could even rebuild its own CLI executable to be able to run on the device and had network access, “Claude” (model actually runs on anthropic severs) could operate pretty comfortably on a smart device.
So, I think it just depends on what you “count” as self replicating. I’d count it. And it’s already easily at that point now.
Your assumption is correct. This is in reference to https://www.anthropic.com/research/self-replicating-ai. This isn’t headlines though it’s fairly obvious to anyone who even occasionally thinks about security
That stuff couldn’t run on my good laptop if I wanted to…
Nvidia is releasing Spark now, which can run agentic workloads on 128gb of unified RAM
Oh yeah everyone has and can afford that
Lol what? This conversation is about the capacity of agentic AI systems replicating across cloud infrastructure, not the affordability of laptops for individual consumers.
The point was you don’t need an entire server farm. You can rent an 80gb H100 on Lambda for $2/hr. A 125gb Spark laptop costs $5k.
If it comes down to an effective worm-like agentic distillation at 50gb, the cost to sustain a small swarm comes way down to the point that the swam could sustain its own activities through different revenue streams.
Once the capability is there at that size, it’s no longer Russia, Iran, or North Korea who could easily drop a billion dollars to jumpstart it. It’s any criminal organization or asshole rich guy who can jumpstart it for the price of a nice car.
You replied to a comment about a guy’s laptop lol
And that’s going to he the new default platform for smart ovens or something?
Because Anthropic up there Is claiming that LLMs can propagate through IoT devices.
Also any model can trivially self-replicate by just being the payload for a worm
AI Bubble will pop and take a bunch of other industries with it.
And nobody will be held responsible and well suffer through the next hype.
Also a good thing since AI is a net negative to other industries.
Okay, first of all, fuck polymarket and all of these betting sites. Sensationalism is their business, so their credibility is nil. They’ve been known to completely twist news stories just to entice people to bet on them. Fuck these guys.
We might as well take him at face value and take an ax to the thing he’s warning us about (that he created). Just because.
I am so fucking tired of betting apps, sorry excuse me, “trading apps”. I had to stop watching the MLB playoffs cause it was just nonstop ads for this sports betting shit.
Meanwhile, Pete Rose isn’t in the hall of fame.
Pete Rose raped a 14-15 yo and shouldn’t be in the hall regardless of how mlb feels about gambling.
But that’s not the reason why he isn’t in the HoF. (You’re not wrong, it should be, and it would likely disqualify others).
I don’t know what you mean. Polymarket is the most authentic representation of humanity possible. /s
This is almost verbatim what that dipshit CEO said though…
rogue ai agents
in my day we called them worms, trojans, and botnets
“Force us off by law so that our business failure is not our fault and the managers legal responsability could not be engaged.” Isn’t it?
These companies are burning cash so that realistically could be the play here, which would be hilarious because they of all people should understand that congress doesn’t pass legislation based on popular opinion so this media blitz would be pointless. They’ll need to lobby congress if they want to be regulated enough to blame their downfall on beimg crippled by evil government meddling.
Praying for public sentiment to spur congressional action would also be funny because there are a ton of focal points that galvanize public sentiment in favor of regulation easily but none of those would hype their product so instead we’re getting cautionary fiction presented as reality and no one cares.
Unfortunately, they used all their investor money buying RAM futures for phantom data centers. Not enough left to buy some new laws.
More fear tactics from the creators. Why would Anthropic warn us on stuff that would hurt the integrity of their product right before their IPO? They wouldn’t unless it benefited them.
They want government regulations in place not to protect us. They want them to slow down any future competition to help monopolize the market.
But what if China destroys the world first? We cannot have history thinking we were slacking in the world destruction department!!
Wtf does it even mean? Claude is gonna install itself on a motion sensor? The entire model? Just the app? Whose credit allowance is it gonna use?
No, they are saying these local models are scary, and instead everyone should be using these nice and protected models in datacenters instead, that fortunately Anthropic will rent access to out of the goodness of their conscious…
The only thing that makes sense is they are suggesting they can attack home assistant servers and use vulnerabilities in the smart home devices as a way in.
From there if your home assistant server has any decent power, or at least a npu then maybe it could do some self replication.
If they used my computer it would take 10+ hours before their ai produced anything worth while, and I would notice it getting hot and unresponsive before that point.
Yeah, good luck running LLMs on my N100…
Sounds like they invented malware.
Building a moat through fearmongering so you all beg for regulation.
Replace warns with brags.
