Post

So the people launching a new Twitter under the name Twitter launched their thing so I signed up. Turns out they have an AI scanning tweets for "truth" and it currently has no idea what it's doing. Posted something innocuous about Star Wars Zero Company and it essentially blocked it from all feeds.

852 reposts3.5K likes

It's because the only thing the AI was trained on were "truths" like "trans people are delusional" and "white genocide is real". Why is anyone still on that platform at this point?

Have they given the codebase to a 9-year old to try and vibe code a moderation system or what? Cause this is what I would make after drinking Vodka and deciding, that I want my own Twitter at home, holy heck xD

Honestly, modern ChatGPT probably wouldn’t even make this mistake. They must be running one of those Chinese models, and probably not with very many resources

Reminds me of that time Grok insisted that the video of Charlie Kirk getting shot was fake. Beyond all its other flaws, it chokes on things outside its training set. And it had a training set full of Charlie Kirk NOT getting shot, so obviously...

So, what you’re saying is that in order to improve Grok Charlie Kirk would’ve needed to get shot repeatedly over a long period of time? I’m not saying that, I’m simply asking questions, just like Charlie did until his very last moment.

"There is no evidence of any war in Ba Sing Se. We are at war with Eastasia. We have always been at war with Eurasia. Dogs also cannot look up and technically Camilla is not the Queen of England as this is not one of her formal titles."

Fact-checking is one of the many things these ShatGPT or Clod programs can *never* do. It's not possible. Truth is contextual. "How much flour do I need?" depends on recipe and, like, if you're estimating import needs for a country.

You can't find truth without understanding everything relevant. This thing can't correlate "tomorrow" as a specific date. It also isn't a search engine, and it doesn't speed anything up, because "wrong answers, fast!!!" is a BAD thing.

Thinking the bot can help them, despite all the evidence, means they can't ever get their shit together. They literally cannot tell if someone or something is giving them good answers. They are incompetent across the board. The project is *so* dead.

An LLM screwing up an off-by-one error and having zero error tolerance is such a good example of why the implementation is below the standards of a junior programmer and not ready for production.

It depends on when the AI was last trained. If you ask an LLM what day is today, it would say the training day (likely months or even years ago in some cases). Most companies would be smart enough to inject today's date before sending whatever prompt. Emphases on "most," I guess.

Wait is it trying to say that you're a liar because you said you haven't played the game in 15 years but its data says some people have played it within the last 15 years so therefore you have too?

Computers used to be good at math and steadily counting up from jan 1, 1970 to infer the current time and date (via math). Through a lot of research and resources, we finally managed to build computers that are good at neither.

You're telling me that the site whose business model is "try to take over abandoned brand recognition" is run by the kind of lazy, uncreative, techbro hacks that use 'AI' for everything? I'm shocked!

This seems like possibly a cool idea if AI actually worked as well as people claim it does, which anyone who actually works with it could tell you it doesn’t.

Wouldn't these people with early access to a video game be under contract to shut up about it? Even if it is true, backing it up might require posting something that'd violate your NDA.

Except it is, and it says so, it just fundamentally doesn't understand that August 27 is in fact tomorrow because it is incapable of "understanding" anything

It's worse: LLMs are perfectly capable of reasoning about dates, it's just that they never gave it any post metadata to work off of, so it has no clue what "tomorrow" refers to Turns out they just did not care to think about any edge cases or test it on any real data

in retrospect, tasking the lying machine with figuring out what's true may not have been the smartest idea

setting aside the idea of using the liebot to detect truth, seems like a non-starter to make a website called Twitter when normal-brained people haven't stopped calling the old place that

"ai 'fact-checking' posts" Tell me you didn't understand a fucking thing about twitter without saying etc. the entire *joke* was that it was real people pushing back at propagandization via the one means available to them: making fun of it & him. "Grok but the other way" still sucks, dudes!

Currently has no idea what it's doing? More like it will never have any idea what it's doing, or any ideas about anything.

AI doesn't know that tomorrow was/is the 27th because it can only understand dates as a number of seconds since 00:00:00 UTC on 1 January 1970, and "tomorrow" is a word, not a number! I mean, that's assuming it does actually process dates via the Unix epoch. Who knows if it does though

You can embed the current date using a dynamic system prompt. Giving LLMs a sense of time is a solved problem. The app’s developers clearly don’t know what they’re doing, though