Post

this isn't cheating, and it's not "absolutely bizarre"! this is just how LLMs work. they are improv machines. they do not have any sense of truth or fiction bc they don't "know" anything. they can't even "know" if they "looked" at an "image." this is totally unsurprising

"seeing" something that isn't there is literally the definition of "hallucination" so i think these researchers had to know what they were doing & were doing it on purpose

the models generally "championed" for radiology are typically specialized, not commercial chatbots aka "frontier models" they still do the stupidest shit — like correlating diagnosis based on which hospital name was on the image — bc there's no such thing as artificial *intelligence*

answer-shaped extrusions can be useful in some situations but literally zero of those situations are where you need 1. facts about reality 2. truth 3. probability 4. certainty 5. important decision-making