7.72 TB, I don’t even have enough SSD storage for this in the entire house lol

if this is real then just the fact that it’s 14T is interesting info about the frontier models

makes me feel like China’s models are at least as efficient as the US frontier models, they’re only behind in hardware

EDIT: this might be fake https://huggingface.co/burner22/numbat/discussions/13

[email protected]

Which model GPU and how much VRAM? 16GB RAM limits your options a bit but maybe LFM 2.5 24B-A2B

If not, Gemma 4 e4b or Ling 3.0 Tiny are about as small and fast as you can get while still being decently smart.

I have 8GB VRAM and 32GB RAM, mostly using llama.cpp to run Tiel 35b at Q4, it’s ok at writing code in an agent as long as it can compile and run tests to iteratively fix its mistakes.

Though there’s been new optimized engines, like Strata, that could maybe allow you to run Qwen Flash Next at decent speeds.

There’s also Qwen 4 coming out soon that may give some good new options for us VRAM poors. Just stick to MoE models.

Usually people don’t use it themselves, you just go on huggingface and search for “Qwen 3.6 35b heretic” or something like that for a premade heretic model.

What are the specs on the computer?

This can happen because of tokenization. Tell it to execute code to do the letter counting and both models will succeed every time

Lol yeah someone tell them about local LLMs, open weights, and abliteration

ANTHROPIC IS CRACKING DOWN ON VIDEO GAME REWRITES 🚨

Claude Code picked up a new rule around Oct 27, sent from Anthropic’s servers under a flag called “tengu_heron_brook”. There’s no setting to turn it off.

The full rule: “Do build original games, games in a genre, and games from the user’s own designs and assets. Don’t build a recreation of a specific existing game, even if it is renamed or called original.”

Is this the end of game rewrites, modding and everything in between?

But it isn’t illegal, so why?

so typical of the American models to be the best at maximizing prices lol

I thought Kimi K3 was funny https://foodtruckbench.com/blog/kimi-k3

It almost seems like it was trying to be as helpful as possible by feeding as many people as it could, too nice for its own good

without the possibility of veering off into a tangential rant about the nature of free will.

you can do that with a regular LLM by using structured responses

for home users they would be more palatable if they didn’t require any extra VRAM, if it was just a different “mode” for your normal LLM

what are the specs? Try Ling 3.0 Tiny, that’s probably the fastest decent model, it should be both smarter and faster than Qwen 3.5 4b

MoE models are flexible, see my guide for llama.cpp https://lemmus.org/post/24235317

Now there’s also --moe-cache-mib that could beat --n-cpu-moe depending on your exact hardware. I’ll need to write an updated guide.

And now there’s Strata and PolyStrata which get even better performance than that.

I just use llama.cpp with Zoo Code, the VSCode extension

join us [email protected]

It’s a MoE model so it’s much more flexible than a dense model, see my guide for llama.cpp https://lemmus.org/post/24235317

Now there’s also --moe-cache-mib that could beat --n-cpu-moe depending on your exact hardware. I’ll need to write an updated guide.

And now there’s Strata and PolyStrata which get even better performance than that.

I didn’t write down my exact tokens/s in llama.cpp before installing the unlocker, but the numbers I got after were roughly the same as I remembered, which also makes sense since I use quantized models that afaik use integer tensor ops.

token generation is bottlenecked by memory speed not compute power. your prompt processing/prefill speeds might’ve gone up

https://piefed.social/comment/13343280

PieFed has the concept of silencing another instance. A silenced instance is not defederated from but their posts do not show in the Popular or All feeds and their communities are not shown during onboarding. Their communities can still be found in the communities list (if you unblock the instance first) and joined in the normal way. Once joined, posts in there show up in the Subscribed feed of the joiner as usual.

Since I added silencing functionality I feel like there’s almost no need for (more) defederation. I can offer protection to newbies who don’t yet know which places to avoid and they can explore the dark corners when they’re ready. It’s a low-drama way to put a bit of distance between groups that rub each other the wrong way.

Yeah default blocks or silencing or something like that

PieFed allows admins different levels of blocking instances, they can do defederation but there are levels softer than that