Post

Almost all of Meta's PR about Muse was about how careful they had been to set it up not to do things like this, how they delayed the launch by months to carefully design it so it could be trusted. And then...

So uhhhhhh… Apparently meta's muse "AI" is just straight up doxxing people to strangers on FB marketplace??? This has the potential to hurt so so many people, and I genuinely wonder how long before they roll out a fix for it.

174 reposts763 likes

LLMs can never be trusted. Muse could work perfectly 95% of the time, but if it's making catastrophic errors the other 5% of the time, it's value is essentially nothing. I can't believe we bet the entire economy on this technology.

The only way to trust an LLM not to do something is to not give it the ability to do that thing in the first place. Otherwise it may absolutely do that thing. Even if you shove a safety classifier in between it and the action.

I know this sounds like a joke, but I am actually surprised it took this long. Genuinely. LLMs are horrifically unsafe with information, and there were probably millions of people hammering at it instantly. I expected this to happen basically within an hour, so...

If someone has a lot of stuff they're trying to sell, could be viewed kinda like having an intern handle the busy work. But, yeah, I dunno. I wouldn't trust it.

And Facebook is so pervasive, their audience will include vast numbers of people who can’t begin to be on top of their consent games.

Good point. The OP lacks any context around what the user authorized the bot to do, and I don’t feel like wading through what Meta’s T&C’s allow for. I just can’t wrap my head around deciding to allow a system I don’t have complete control over to conduct business on my behalf in any capacity

“Move slow and break things” doesn’t have the same ring to it, but I guess it’s their modern motto?