Post

increasingly believing much of the communication gap between LLM Enthusiasts and LLM Skeptics on this website boils down to “are you someone who has largely experienced a *reasonable* amount of job security in tech, or are you someone who has not experienced job security and likely aren’t in tech”

118 reposts1K likes

i mean yeah but also. i'm worried someone will feed me a recipe they got from genAI. i really wanna gently wean people around me off using them as a replacement for google search, for my and their health

Unfortunately, on a very short timeline there will likely be very few traditional search options remaining. Google already seems to be like 50% of what it once was.

Had a Zoom meeting where my tax professional was using Google Gemini to look up the tax code, and I am thinking to myself, what am I paying you for?

Perhaps the tax professional will flag sooner what doesn't make sense in Gemini's answer and double check? Perhaps said professional knows which question to ask? Perhaps if anything goes wrong you can blame the professional and its employer (who value their reputation)? I can think of reasons.

I also think some of it is like the sometimes pretentious nature of people who have knowledge of a common technology that most people don't understand. Having worked at an auto parts store for a few years I know for certain it exists in that industry haha

I say this a lot but really Confirmation bias rules everything around me If you have spent a great deal of time learning about, thinking about, working on that thing... You are going to think differently about that thing than other people do

I'm a sceptic but due to safety concerns. I'm a social worker who likes how some modalities like dbt can have parts boiled down for wider use. I think a dbt program where the workbook+group+on-call therapist also had a chat app could be good. I'm scared insurance will cut previous things 4 an app

This resonates w/ my general exp. Also though, I’m experiencing… younger gen folks who rush into using LLM for efficiency w/o having expertise in the area they are efficiency-ing. For ex, using a tool to streamline bookkeeping is nice, but 1 still needs to know what was really spent on what…

I had someone run decades of my field & academic work into an LLM, read an error-filled 2 pg summary, & tell me they understood my work. I’m not concerned w/ being replaced. I’m concerned w/ being replaced by a tool that substitutes experience for efficiency & knowledge for expediency.

Learning is tough, and shallow learning can feel comforting and often folks can get pretty far on shallow learning (its still learning) Knowledge is the wicked problem of wicked problems What they did was clearly nonsense, but the knowledge mismatch that can happen because of language is {cont}

1/3 also an issue The story of Tal Golesworthy shows this really well. He was a process engineer in high pressure systems, and instead of accepting the typical procedure introduced a new one that is very successful Im mostly just agreeing and LLMs are just going to make it all worse LLMs {cont}

Old building structure engineer? I bet thats both awesome and impressively frustrating I cant imagine the number of meetings you must attend Like, at least with a new building, one only has to do tons of corporate meetings I hope you get to do lots of what you actually wanted to do

Indeed. Socmed plays to our social proclivity for gossip. We’re killing ourselves @ the speed of Send. We consumers are entirely too eager to seek out channels that validate our existing opinions & accept (& share/advance) content w/o any concept of source credibility or fact verification.

I disagree with this categorization. I work in tech and the divide I see has nothing to do with job security. If anything, those who have never experienced job insecurity are the most afraid right now.

The most bullish people seem to be the ones who barely made it in. Juniors who don’t love the craft but were promised big money by coding bootcamps only to graduate into a retracting job market.

I think this is super real, and I want the conversation to move here. The longer we stay in the "is it useful" debate, the longer we defer taking action to protect ourselves in a changed world.

shout out to this imho _incredible_ @himself.bsky.social thread, which i think super nails the cognito-hazard of over-polarizing oneself. we generally OUGHT work to be receptive to many ways the world is happening around us, even admists clear bad. don't affix thineself. bsky.app/profile/hims...

Henry Farrell@himself.bsky.social

4. I think that it is important that critics of LLMs get this. The 'LLMs are useless which is terrible and everyone is using them which is also terrible' shtick contained contradictions even in the beginning, which took a lot of work to maintain . Now it contradicts people's lived experiences.

I am pretty concerned about a world where there's only 2-3 companies that can run these models. I have been spending the last few days idly musing about a coop that sets up hardware and runs the open models.

Bit premature maybe? If the big labs are losing money, a coop is both impractical (tokens at cost will be too expensive) and it is everybody's civic duty to help big labs lose more money by (ab)using free allowances and maxing paid plans.

iiuc the labs are making a net profit on inferrence (or at least on the paid stuff), and the losses are because they're pumping everything into training as fast as they can?

Heh I'm not quite so adversarial as the last half of your statement, especially since I think companies go through lifecycles during which their initial growth tends to produce more social value than they capture and so I wouldnt want to interrupt that - yet But yes it's premature atm

(Tongue planted firmly in cheek) if only there were a trustless decentralized mechanism for assuring service (preferably in TEEs) and a means to do global payments between providers and consumers

There’s a LOT of financial pressure behind architectural research that will make it easier to train and run all kinds of models (beyond just LMs) - I’m working at one such lab. I think we will see many approaches (and this one is one that’s necessary) come online in the next year or so.

frankly i’m already impressed by the models i can run on my phone. knowledge is an issue, but their ability to perform purely language-related tasks isn’t really all that far off the big models at all

You can run a decent model on 16 gigs of ram on a M series Mac now. Building agents is a lot like web dev, request response and doing things in between. I have enjoyed working with the smaller ones, it’s interesting what can be done.

one underappreciated fact is that there are like 100 “neoclouds” out there right now that you can go to and run open weights models

Regarding the employment future around software, it's hard to make predictions right now without knowing where the model capabilities land. I barely know how to think about hiring right now.

I think the cognitive load required to make something that conforms to your firms expectations will still require people regardless of how efficient these models are. Similar to how outsourcing your core product never really works I agree the future is less concentrated tech talent

My most optimistic take is that IT departments in non-software-oriented companies might be able to expand their scope to creating and maintaining inhouse software. Based on the level of expertise still required in the current generation of models, I think that's a reasonable idea

I mean, do we have to wait for capabilities to land somewhere? Seems like there is some monotonic increase wrt to compute scaling. So we can bet "capabilities will keep increasing." If we keep waiting for them to "land" we are going to be waiting till t -> inf. I just work backwards from:

My company doesn’t do exactly this…but we’re getting kinda close, including fixing up inference projects to get decent MoE performance on the smallest possible yet still adequate infiniband connected systems. I guess DM if interested in the general sense?

I expect the models will become commodities. Open ones are not that far behind. I see the risk as that the companies de-skill huge numbers of people who become dependent on the convenience of their systems. Then the prices will start going up and the companies will manipulate their users.

new model (pun not intended) for hackerspaces: shared compute / LLM stuff I have wondered about a coworking space where everyone could hook up their compute and collectively power a distributed model

This may become a necessity. Again, if models become "super intelligent" whatever the heck this means and there are only like 3 providers ... that is very very bad under the current conditions. We need to hedge ... but all the talent is concentrated there.

More than just running open models, there is an opportunity to provide small models trained for a specific task. Agents defined for a specific task, do not need a general purpose LLM. They can use a task specific model. This reduces training and inference costs.

i think it's cool that the billionaires get to decide to shake society and see if it breaks and none of us get to do a damn thing about it

I mean I can't speak for anyone else but my entire career has been contract gigs in tech. I think you've got a point but even tech is, as you said, more precarious than before. (Notably the biggest LLM boosters claim they want a UBI to account for the shift, perhaps as fig leaf )

I think a lot of people who are well-intentioned LLM boosters who have been able to fairly reliably find well-paid work in tech really do struggle with putting themselves in the shoes of people working in other sectors that have been feeling precarious for a long time and now feel WAY more so

I think the biggest issue is that if the AI future is to be believed, "prompt engineering" should be an extremely transitory phase nobody's getting "left behind." it's a machine that understands human language - in context. if it works correctly, there should be no effective learning curve.

yes, you can reasonably argue that People Should Adapt and all, but the likely runway for how one does that while retaining a non-abusive job that pays a living wage is arguably more coherent for people in tech who make software for a living than for many others who are not

I really don't think one can reasonably argue that the unethically trained machine that makes its users dumber, is driving environmentally destructive industrialization, & is part of a tech industry circle jerk that is almost assuredly going to crash the economy is something anyone should adapt to.

I do see posts from LLM enthusiasts that boil down to “critics are just mad the computer is better than them at trivia now” and idk, I think *most* critics are just genuinely terrified they’ll never find work they don’t hate that pays a living wage again in the current batshit climate

Speaking for myself, I'm mad that every CEO in America is drooling over the idea of replacing humans with a probability distribution in a while loop, which is at 80% as capable as a human on a good day, and dangerously wrong the rest of the time. Which millions of people trust as "intelligent"

I agree that it’s silly to claim that LLMs Can’t Do Anything (obviously they can do many things). I also think it’s silly to claim LLMs Can Do Everything (obviously they can’t). regardless of how one feels about that, this is a very scary time to need a job and people are reacting accordingly

And it's not just AI taking jobs, it's the unbalancing of the economy, the impact of misapplied AI that will harm profits & therefore job creation, the inevitable bursting of this monstrous tech bubble, the fact that regardless of actual utility powerful idiots will misuse it & damage us further...

My skill set professionally is photography, video production, graphic design, and illustration. I am not in a good place job wise. And I’m 43, so I’m not in a place where I expected to have to retrain for some entirely new career and start back at the bottom.

There's definitely a worry about job security, but there's also a sense of pride in your work – especially for people who see their job as more than "make line go up". We've seen what has happened to journalism as more and more of it has been outsourced to hallucination machines, it's got worse.

I think many critics are also immensely frustrated by how the very real shortcomings of LLMs (shoddy research, misdiagnosis, plagiarism, etc.) are brushed aside because people value the cheap & shiny object over real expertise and accountability

There’s might also be the consideration that an LLM doesn’t need to be able to do your job, someone just has to THINK it can do your job to cast people aside or put downward pressure on wages.

Many of our customers (in B2B software) have been asking us to make their jobs irrelevant for years (before the current round of LLMs). AFAICT they assume they have the job because of incumbency, but dislike it because it's hard, and would like to keep the former and ditch the latter

All the economic studies I've seen show that economies adapt, not people. When the mill shuts down, the millers don't learn to code. They eat through their savings and fall out of the middle class. More people coming up learn to code, but those workers laid off are just fucked for life.

I mean I have always had very stable jobs 17 years at my last 4 years at current but im hardline against AI and frankly see it as tech that will wreck the world. Use of water, eroding of trust, giving it automation to murder people, stolen works, expected to just consume garbage now, etc

I think it also is some selection bias on who makes it in. There are probably ten upper middle class kids with good but unremarkable private educations for every one of me, who went to public schools the whole way and got lucky. And that's before you factor in visas from abroad too

What concerns me as someone who is in tech and also a skeptic is that I cannot bring up reasonable concerns around AI with people I work with. "Is this a good use case?" is often met with "You're a Luddite for questioning it". Love a tool that I'm never allowed to question, ever.

And they never stop to think that this was exactly what the Luddites objected to: having new technology forced upon them that was clearly only going to benefit its owners.

I don't think "LLM Enthusiasts" is a monolithic group. There are people who use AI cautiously and mostly for coding (like me). There are others who have fully drunk the cool-aid. These tend to be executives and aspiring executives. These groups are different.

I certainly don't think it's a monolithic group, but I used that shorthand because that is how both writing and Bluesky threads work

I do think Bluesky is a useful forum for debating "what is a responsible subject area to use AI, and how much use is acceptable". But I don't think the rabid AI boosters are really on here.

There are a few here and there who pop out to call researchers who don't embrace AI stupid every so often, but with assorted honeypots making the less-wary easy to block they are getting few and far between.

This is why I found the weird wagon-circling around this guy perplexing

KetAnthropic JoshAI@ketanjoshi.co

I am so fascinated by why this seems to have specifically caused an outbreak of ACTUALLY HE'S RIGHT from a bunch of white gen x / elder millennials here because like....what is different today than a month ago where people seemed to have some connection with reality? And why Claude specifically?

On this site I think that's pretty accurate. It's different on Threads, where the AI boosters seem to mostly be extremely obvious grifters who use AI to make you feel obsolete or worthless so they can sell you a course in AI lol

Periodically I got here and respond to their posts about all the incredible things they are making and engage with them, and after a few back and forths ask them to show me where to buy or download the actual apps they claim to produce and they immediately ghost me 100% of the time lol

Also the massive gap between the reality of what the tech can actually do well & what marketing hype *claims* the tech can do makes me automatically suspicious even though I support using AI in appropriate use cases. But it's constantly, dangerously getting shoved into wildly inappropriate places.

Yeah, the "fixes" invariably involve humans having to work harder than they would have if they hadn't used AI at all. In addition, AI companies take your inputs & make them accessible to the public, which is why my company forbids putting anything in it we wouldn't mind seeing on a news website.

idk I have a weird perspective as a tech process person. i've generally had reasonable job security in my career and I am very, very hardcore LLM Skeptic - but also I work in incident management and have seen what happens when shit goes wrong for 20+ years. So...

saying "LLM skeptic" is like saying "child rape skeptic". if you aren't fully grasping the true horror of this technology, you are already on the losing side.

Yeah. I fall into the "have job security in tech" category, and so do most of the people I work with, and I attribute the difference between my attitude toward LLMs and theirs to all the artists I follow on bsky. Without that exposure, I'd probably be an unrepentant booster like my coworkers.

there's also the whole these tools are made and promoted by deeply unethical people, were created in deeply unethical ways and the goals of the folks pushing them are deeply unethical i can't get enthusiastic about anything created under those conditions.

musk, altman and amodei are not creating tools to make the world better they aren't that kind of human so naw don't want to promote their ideas which generally have a core of "i am better than everyone else and also the only person truly worthy of life"

idk if you're talking to me but i am extremely demonstrably not an AI enthusiast or a fan of these companies or the way they're developing these technologies, on the record

There is also professionals trained for robustness and safety. Real engineers, serious military officers, these kind of people. We need to understand the underpinning of any technology we use, its weaknesses and real capabilities. And sorry but in this regard gen AI is scary.

There was an episode of Cautionary Tales about a plane crash caused by a baby pilot trained using AI. The plane got into a Situation, the AI shut down because things were too complicated, the baby pilot was used to the AI watching certain indicators for him, the other pilot wasn't paying attention.

I'm in an odd position because basically the only reason my client is paying for me this year is because I investigated AI and can speak to it. Half my team is gone. One of them fully laid off. So not really secure. But I also 100% get and agree with a lot of concerns.

But at least for me in my industry I don't really think I have a choice. I need to learn how to use AI to my advantage because if I don't I won't get a paycheck. I do think it's incredibly powerful. But I also think that most booster discourse is fart sniffing

As someone who’s only known job security in tech, but seen what American capitalism does to skilled people who do good work when given a chance, I’m anxious I also think there’s something in the air in tech rn, a sense that when it comes to AI you have to get with the program or be left in the dust

I have been working a programming job at the same company for 16 years. I‘m skeptical about not only the underpinnings of the results produced by LLMs, but also the whole rush to build entire business processes around them. Businesses getting way out over their skis to be cheap. houses built on sand

I think this is pretty much bang on. My day job is in tech and I also work and mix mostly with the art community outside my usual work. Many people in tech seem truly surprised at my resistance to AI tools and are very unaware of many of the reasons that people feel opposed to it.

A friend who is an electrical engineer had a situation where another engineer insisted ChatGPT knew details about a circuit board they were using. My friend insisted not because it is an internally developed board, no information on the web. He still insisted it should know. An experienced engineer!

I recently had a conversation with an engineer where I asked if he was concerned about building production code with AI when it appears genAI creations can’t be copyrighted. He hadn’t considered it nor had he heard anything about possible copyright issues. In the tech world it doesn’t even come up.

Most software engineers do most of their work under work-for-hire *or* under contributor license agreements *or* under some copyleft-or-adjacent license. I think artists do a lot more portfolio-building and personal work where they presume copyright ownership.

Copyright just isn’t important in tech. We get best protections from trade secrets, second from patents. Closed source code just isn’t published and devs work almost exclusively under for -hire arrangements. It doesn’t come up because it’s not applicable to the vast majority of work being done.

Most of us also came up when copyright trolls were trying to strangle individual coders doing open source work, the same work that enabled a lot of us to learn to code and find jobs that pulled us out of the struggling working class we grew up in.

I have spent a lot of time watching companies refuse to invest in appropriate backend systems for support and operations. And seen all the wackadoo situations customers get themselves into that require super specific intervention. So I am not convinced LLMs will be different.