Post

I do firmly believe that refusing to outsource your basic cognitive functions to LLMs right now - as so many are stumbling over themselves to do right now, like hogs trotting to a pile of slop that’s been set up inside of a butcher’s delivery truck - will very much pay off in a few years.

And by this I don’t even mean “refusing to use LLMs for anything at all” - they do have some use cases - I mean “refusing to outsource huge swaths of your day to day brain functions to the lying machine.”

75 reposts1.4K likes

Slippery slope from using an LLM to sort/cat data to slopping yourself. As with everything else free on the internet YOU are the product and addiction to it is the point. Agree to disagree with you and OP. Stay away from this shit unless all it does is check your PowerShell for errors.

It’s gonna be worse those companies that are overindexing on LLM usage. It’s getting to the point where directors are asking for that as a standalone metric at business reviews & shit. HR managers & UX designers don’t need ChatGPT to summarize their emails. At best, they’re downskilling people.

Partners company have a hiring freeze while they look into how they can utilise LLMs. Hoping it comes back to bite them, has pissed off many who have been denied leave & transition to retirement. Real possibility some will just quit which is a problem as takes 6 months+ to train replacement.

It's insidious how companies just expect employees to use LLMs for everything now. I worry that if I ever have to look for a new job, I won't be able to get one because my answer to "How have you used AI in your work?" would be "I don't. I can't trust LLMs."

Meanwhile if I were a hiring manager, an employee distrusting LLMs would be a MASSIVE, HUGE green flag because that means they understand what LLMs are and why it's a terrible idea to lean hard on them for your work.

The one decent use I've seen is really small scale stuff like notebook llm for building an interface to ask questions about a bunch of documents (like, design and planning docs and stuff). You want a small, tightly focused model with a corpus that's all interrelated. All the big llm stuff is crap.

The thing I'm describing is roughly the value add of some kind of free addon for the intermediate tier of a Salesforce plan or something, it doesn't justify any of the enormous time or money or environmental damage, and it's like a x0,000 dollar business not a trillion dollar one

It rules that some of the most credulous Business Idiots in the world decided to try to reorient the entire tech industry around a cross between a mildly useful word plugin and a magic eight ball, love this for all of us

Things with large amounts of data where false positives and false negatives are not a problem. So selecting candidates for a medical study, for instance, where you have access to millions of patient records but you only need a thousand. It can whittle it down to a list you need to review.

It's like some sort of highly specialized mining equipment, something most people don't need and wouldn't know how to use. It's being sold as a replacement for screwdrivers, a task it absolutely cannot do. But for the most part, I agree with you, it's largely useless and not worth it

LLM can organize these 100 messages into similar buckets so I don’t have to do it myself. I still have to double check all of it and make sure it makes sense but it’s easier than starting from scratch

I've so far seen 2 solid use cases of AI in my line of work: generating a first impression of spectral flow cytometry panels that are unmixable and halfway decent first runs at scaling the data derived from that. Both directly downstream of significant amounts of expert curated data. And that's it.

I would pay actual money to hear any one of these AI hyping fops to give an honest breakdown of costs and benefits. Like here's the real cost of compute in 2025 dollars, and this is the real use case that would at $15 minimum wage cost X. But it's all just incomprehensible gobledigook.

Don't get me wrong, I tremendously enjoy trying to get AI image generation to add cookie monster or oscar the grouch into scientific imagery, but it's not exactly worth the real cost (be it old growth forests or poisoned minority neighborhoods) to justify keeping it.

I still personally refuse to use them for anything out of protest. I know I am robbing myself of some use cases but I still personally believe the energy costs and pollution just isn't worth anything I encounter in my day to day

The most important skills for “using AI” are problem framing and analysis skills that you only learn by solving problems the old fashioned way. I believe that AI is good for more than just search but you can’t access any of those capabilities if you don’t know how to set up the problem properly.

Agreed. I really see it as so spotty and more of a pain sometimes to use for anything complex. Basically use it like for assistant low level internship work and I think you're fine. I like using it for making simple Excel charts or just drafting an email before I go back and revise that shit again.

Unless you have a human knowledgable on the subject vetting a machine's output, you can't trust anything that the machine confidently says is right, or even real. I can hallucinate perfectly well by myself, thank you; at least I can tell when I am hallucinating.

I would call it a "bullshit machine", in the sense of bullshit described in Harry G. Frankfurt's treatise "On Bullshit". The LLM can neither lie nor tell the truth because it doesn't have intention. It's bullshit in its purest form.

(I probably botched it, a lot's been happening in my life since I heard this talk and frankly keeping my eyes open and putting one foot in front of the other has been tough work. But I still do insist on knowing things. Also, Ken is a great, engaging speaker, as it turns out.)

not to disagree, but the downside is we have to deal with those smooth brains as a former academic it became kinda disheartening around the middle of the last decade when use of even moderately uncommon words or complex sentence structure would result in "is that even English?"

i remember confusing someone once by using pronouns. as in they couldn't follow that the subject named in one sentence was the object of the pronoun in the following i remember because it took me a good 10 mins or so to finally realize that was the issue for them

it is interesting that the people who claimed AI would free us up to focus on art or history or getting started on that novel youve always wanted to write immediately oriented their LLMs to do worse versions of that stuff