Post

I just don't see H sapiens ceding decision-making, directive authority to machines. "But what if the machines make better decisions? Competition will force ..." Look around this ridiculous planet and ask yourself how often competition has forced hominids to cede power to the best problem-solvers.

Zach Weinersmith@zachweinersmith.bsky.social

So, there's a book I want to read that doesn't seem to exist, which is one that takes seriously the idea that over some not-too-short timespan a lot of meaningful human work is better done by machines, then asks (assuming it's not the apocalypse) about the social/ethical/philosophical aspects.

10 reposts95 likes

There's multiple paths eventually leading to the same direction. It may first be about saving costs and so on but extends naturally. Killer bots is no doubt a crazy path, yet one already taken, as fastest decisions win, EW makes comms unreliable, and humans prefer not risking themselves.

I think there’s real decision-ceding creep over time. When I enter a destination in Google Maps I am ceding the decisions about which route to take to their algorithm. When I doomscroll I cede the decision about what to watch to TikTok. I think over time we lose perspective on what we’ve ceded

if they make better decisions then the organizations that adopt them in a decision making role should out-perform those that don't in economic or political systems. unless you outlaw them from being used in such a way, i don't see how you escape competition dynamics.

Wouldn't the same argument imply that nations and companies are generally led by the best-informed decision-makers and problem-solvers? If they weren't, after all, competitive dynamics should long ago have pushed that nation/company aside. If this is not what we observe, we need to ask why not.

Lot of possible explanations, but this one is old and deserves to go first: "I returned and saw under the sun, that the race is not to the swift, nor the battle to the strong, neither yet bread to the wise, nor yet riches to men of understanding ... but time and chance happeneth to them all." :)

One of the most important variables in the future over “AI” adoption is: “Do those in power perceive a benefit in widespread use of the technology?” The perception can be the result of rational judgement or not, but my concern is that we should want the people making such decisions to be varied.

One of the studies I loved was that if you measure doctors' skill at diagnosis, it's good. If you measure AI's skill at diagnosis, it's good But if you pair a doctor with an AI, the quality drops significantly. Why? The doctors frequently overrule the AI's (correct) decision 😆

So, machines may get good at drawing or writing or folding proteins. But I tend to think we'll keep telling them what to draw or write or fold — and keep finding meaning in that directive, synthetic task. Partly for good reasons, and partly because that just seems like our M.O.

By the end of 2025, all one-way drones and cruise missiles will have computer vision for target identification to avoid radio jamming. This is already a real, deployed technology.

High-frequency trading is another established case where people choose to cede decision-making to machines - in this case directly in service of aforementioned "market forces"

My thoughts exactly. Worst use first.

Pekka Lund@pekka.bsky.social

There's multiple paths eventually leading to the same direction. It may first be about saving costs and so on but extends naturally. Killer bots is no doubt a crazy path, yet one already taken, as fastest decisions win, EW makes comms unreliable, and humans prefer not risking themselves.

I'm guessing we will learn about the first major AI CEO via some scandal. "Turns out our company made huge loss because our CEO had given control to the smartest LLM model, which in turn had given control to the cheapest LLM and used its own computing power for finding cure for cancer instead."

I feel like the word “meaningful” ends up doing heavy lifting, but I feel like lots of decision-making is *already* ceded to organizational processes, which aren’t really that different from ceding to machines? Healthcare, legal outcomes, hiring decisions…

I don't think one size fits all. I've encountered people in creative industries who wanted AI in one case *because* it allowed them to cede creative control to it, in another (I think) because for them success>control. OTOH where decisions = power it won't really be ceded, but we'll be told it was.

We collectively have a really diverse set of desires... as many people who want to express themselves as people who want to plumb the mind of a machine zeitgeist searching for scraps of distilled enlightenment or who want to reach a purity of practice in which the self is subsumed in the art or ...