Post

People quoting these AI summaries for fact checks drive me wild. I sussed out a core factual conflation it made between two areas of a technical standard last week. It's good I didn't trust it. Glad I grew up with Wikipedia being drilled as untrustworthy. Wikipedia has issues even when sourced!

Jason Schreier@jasonschreier.bsky.social

I was excited to tell my kids that there's a sequel to Encanto, only to scroll down and learn that Google's AI just completely made this up

engineering-nerd.bsky.social

@engineering-nerd.bsky.social

28 Dec 2024

But it wasn’t made up. There’s an actual wiki linked where the model pulled that information from: ideas.fandom.com. The scarier implication here is that all these gen AI models are open to easy manipulation by malicious misinformation ON TOP of their already established propensity to hallucination

Nicolas Noble

@nicolas.grumpycoder.net

To be fair, this would've been an issue even without ai summaries. It's just that the summary makes it look more official.

29/12/24, 12:04 am0 reposts0 likes

No replies yet.