Post

this isn't cheating, and it's not "absolutely bizarre"! this is just how LLMs work. they are improv machines. they do not have any sense of truth or fiction bc they don't "know" anything. they can't even "know" if they "looked" at an "image." this is totally unsurprising

"seeing" something that isn't there is literally the definition of "hallucination" so i think these researchers had to know what they were doing & were doing it on purpose

the models generally "championed" for radiology are typically specialized, not commercial chatbots aka "frontier models" they still do the stupidest shit — like correlating diagnosis based on which hospital name was on the image — bc there's no such thing as artificial *intelligence*

answer-shaped extrusions can be useful in some situations but literally zero of those situations are where you need 1. facts about reality 2. truth 3. probability 4. certainty 5. important decision-making

i wouldn't even say "pattern-finding" but they can be reasonably good at surfacing/extruding them ~accidentally~ hehe yeah, idk why people who ought to know better treat llms like universal tools. i know it's marketed that way but that literally harms the perception of the product? it's weird

I meant pattern matching in a more mathematical sense, which is problematic because “pattern” means something different in common use (hence the correlation comment)