We’ve tried nothing and we’re out of ideas.

I think you are right, but that seems VERY unenforceable.

I’ll have to try that, for my part qwen-3.8-flash-next has been a world of difference

Gravity, Wicked

Qwen3.8-flash-next broke the vram requirement with its new architecture (which is a preview of their 4.0 architecture). You can run a 177b parameter model on 12gb VRAM, 64gb ram and 80gb SSD at 30tok/s and the speed scales almost linearly with increases to vram.

Incidentally, this was proven at almost the exact time all the calls for “regulating local models because they’ll spread into the toasters” started.

You absolutely can have local models that run on consumer grade hardware, and the proprietary companies know it and are scared to death.

Not only that, but you have immediately enslaved it for profit… What possible positive outcome for Anthropic could have come from this?

This I think is the main problem to adoption. It’s very hard to come across Lemmy results on a search engine even if I’m trying to specify Lemmy. (Not that search engines matter for most people these days what with the LLM executive summary pushing out real web pages, who needs resources when you have slop, am I right? \s)

Don’t feed the AI bro hype