Post

i think tech and ai positive people are going to be in for a big shock when anti tech and anti ai sentiment becomes a major part of leftwing politics going forward especially as datacenters continue to destroy communities and raise electricity bills

Armin Ronacher@mitsuhiko.at

Is this platform still massively against AI or has it moved more towards acceptance?

Same as it ever was, tbh Not long ago Wikipedia was the leftwing devil over Assault Rifle/Armalite Rifle brigades If you're not behind solar and wind energy driven around by little AI/AI adjacent tech then you aren't actually left. Musk and Sama ruined stuff, but now they're gas/coal geezers

Given enough time we'll have open source and home made small language models that (yes, accurately, yes, without hallucinating) teach crochet and organic farming. It's far too useful-yet-horribly-boring to ignore, just like blogs, patreon, wordpress, wikis, reddit, blah blah blah

0 reposts0 likes

It doesn't need to. If the training data is about crochet and you ask about a "double puff" it will provide some sort of answers about crochet - with the assumption that "double puff" has been used as a term it will produce the "correct" answer. With RAG updates it gets better without training.

Yes, you will. The problem of hallucinations is inherent and unsolvable - and, in fact, a feature of LLMs. But that does not mean you can't get deterministic answers. If you ask for a "double puff" a specifically trained crochet model is not going to go ChatGPT on you and talk about birds.

I appreciate this answer :) But books don't have ctrl+f or search boxes and about the time you've screwed up hours of work because you don't know what a certain stitch is... I mean at least vector search is useful. :)

I was at some AI sales conference at Adobe head offices in London. Not by choice I assure you. Specifically asked their main AI guy why LLMs hallucinate and if there’s work being done to solve the problem. Said it wasn’t his department but one of his people would reach out. That was eight months ago

I've seen AI bros make unhinged claims that Human minds are also just statistical predictions of what is the most satisfying outcome. I mean, I can see that it might be the case if someone is an AI-bro and lets ChatGPT do all the thinking for them.

LLMs fundamentally cannot stop hallucinating, because they're just word guessing machines. Also, we have libraries of tens of millions of videos and articles on how to crochet and farm. Having an LLM rewrite it into bullet points doesn't significantly help anyone.

Is this an honest reply or kneejerk? Are you saying you cannot make a small LLM that gives you correct answers? And you think they only output bullet points? I have news A small model can be offline and edge - no need for 10K hours of video. You can get a step-by-step generated with licensed images

You can get a step-by-step guide for both of those things from WikiHow, or any number of other sites. LLMs cannot guarantee "correct" answers because they have no concept of correct, they're just working out the most likely next word. That's why they can't do math reliably.

Offline? In braille? In 27 languages? You all are going to be very surprised when you figure out the mistake that's being made here. If I ask Gemini 3 which US state is in the mostest south left - it will say California. That is correct every time. This is all that is needed to explain a stitch.

Oh, on a side note: Your electric bill isn't *only* data centers. Even though the US and EPA are destroying our solar plans as a country, battery and solar cost is through the floor. As people implement this stuff for themselves your electric bill will go up in response to supply and demand. Sorry.