Tired of AI hype posts? You might like my sober assessment of whether AI-generated summaries are suitable for studying and research. Spoiler alert, they are not.
The text is primarily aimed at students and researchers, but has much broader relevance. So share freely!: www.tue.nl/en/our-unive...
Third, automating science is not really possible in the way described. In the same way a machine cannot eat food for us because we'd starve: scientific understanding is for us to experience and share with others as a psychological state. It's a process and a cognitive state not an output.
It's not like biology has a single definition for life — nor do they need a definite meaning to start work. The whole point of science is the understandings produced by the work: that's what knowledge production is. You don't put definitions in and out comes something else. You toil to understand.
Was reminded of this by someone's questions to me about how to argue against the (common) claim that LLMs can "summarize", so reboosting as a gentle reminder for you all too
The new Dutch Code of Conduct for Research Integrity has launched and it includes new sections about AI in research. These could have big consequences for how Dutch universities adopt GenAI in research and education.
www.knaw.nl/en/publicati...
⬇️
This means that when a university recommends a GenAI tool or even licenses it to their researchers or students (aspiring researchers), they need to show that the tool does not infringe on academic integrity principles by design. Will tools like ChatGPT and Claude pass that test?
⬇️
Companies like Anthropic and OpenAI are under scrutiny for copyright and human rights violations, unjust labor practices, unsustainable energy and water use, and the deployment of AI hacking systems. Can an academic use such a tool without breaching the Transparency and Responsibility principles?
The new Dutch Code of Conduct for Research Integrity has launched and it includes new sections about AI in research. These could have big consequences for how Dutch universities adopt GenAI in research and education.
www.knaw.nl/en/publicati...
⬇️
In the duty of care section of the Code, universities are not only urged to make clear guidelines on how researchers can use AI in alignment with the Code but also what technologies align with it.
⬇️
we're in a time where "this email chain could have been a simple meeting" is a bizarre new truth that clashes wildly with just a few years ago where academics were whinging about meetings
“If we only see the mind as a computer, AI might seem advantageous to learning — this is why many dream of building AI tutors. But already such efforts are failing, because our minds are more than just input-output devices.”
www.theverge.com/ai-artificia...
Dear @erc.europa.eu , we DO already have common standards & frameworks. 'AI' likes to pose itself as 'special' but we do not need to reinvent the wheel. We already have established codes of conduct for research integrity. We just need to apply them.
See below + more resources in thread🧵
There is a need to agree on common standards & frameworks for AI models used across all aspects of research evaluation. These should ensure & encourage trust, confidentiality, & transparency, & should be defined through collaborative discussions between research funding and performing organisations.
We need libraries as safe havens for printed books more than ever…
“…a copyright lawsuit from book authors against Anthropic revealed internal documents detailing its plan to obtain and scan millions of printed books, and destroy them in the process”
www.404media.co/ai-companies...
“This bookseller said his inventory is full of rare, foreign language, and low circulation books, meaning that if they are destroyed in the process of becoming training data, they’ll be even harder to obtain.”
Tech CEOs are promising us AI that will soon be as capable as humans (AGI). Some computer scientists are not convinced. Iris van Rooij has warned about the “intractability” of human-like computer systems for decades. We are now seeing signs LLMs are indeed already unscalable at levels far below AGI.
Entirely as expected (see link.springer.com/article/10.1...)
---
“Epoch AI … published a graph last year … It shows the exponentially increasing costs of serving more “tokens”—the words users type to chatbots—with several public AI models.”
article: archive.ph/IrNBI
(h/t @maartenp.bsky.social)
Entirely as expected (see link.springer.com/article/10.1...)
---
“Epoch AI … published a graph last year … It shows the exponentially increasing costs of serving more “tokens”—the words users type to chatbots—with several public AI models.”
article: archive.ph/IrNBI
(h/t @maartenp.bsky.social)
I'm attending a digital humanities event in Montreal. There was a keynote on AI and something about the talk made me wonder if it had been written by Claude. I said as much in the Q&A. As I posed the question, the speaker shifted, looking slightly uncomfortable. What he said next shocked the room +
At the end of the term I asked my college creative wriing students to submit anonymous thoughts on AI. No real surprises: Mood ranges from resignation to despair, capitulation from embittered erosion of standards to total, feelings of betrayal from deep to furious. 1/
This is funny, because it confirms that LLM-powered chatbots are easily jailbroken (guardrails are a sham) and it makes Anthropic admit that despite their scaremongering hype marketing, Mythos is not some super hacker. It can spot simple, known exploits like any other model.
Twenty years ago, climate denial was a problem of the right. Today, AI denial is a problem of the left, and the consequences could be even more disastrous.
www.youtube.com/watch?v=KpTZ...
I guess I'll keep shouting this message from the rooftops until it sticks. Lumping disparate technologies under the ✨"AI"✨ label only inhibits clear discussion and reasoning about what each does.
>>
Jammer dat Koen Haegens niet wat kritischer is hier. GenAI bedrijven richten zich op programmeren omdat het de enige functie is die enigszins fatsoenlijke output genereert, niet omdat de tools zichzelf daarmee snel kunnen verbeteren richting AGI. Dat is pure hype. www.groene.nl/artikel/wach...
Jammer dat Koen Haegens niet wat kritischer is hier. GenAI bedrijven richten zich op programmeren omdat het de enige functie is die enigszins fatsoenlijke output genereert, niet omdat de tools zichzelf daarmee snel kunnen verbeteren richting AGI. Dat is pure hype. www.groene.nl/artikel/wach...
Daarnaast klopt het ook niet dat verbeterde programmeer-“skills” van GenAI tools betekent dat ze ook op alle andere terreinen “slimmer” gaan worden. De LLM’s onder de motorkap kunnen nog steeds niet nadenken, hallucineren in het wilde weg en hun output blijft een op statistiek gebaseerde imitatie
Al sinds september heb ik kanker. De ziekte is nu weg, maar om terugkeer te voorkomen of vertragen is een medicijn nodig dat voor mij niet wordt vergoed. Gelukkig zijn mijn vrienden een crowdfunding gestart. Alle donaties zijn welkom en delen helpt ook! www.gofundme.com/f/help-floor...
Once you have a basic understanding of how these LLM-powered chatbots work this shouldn’t be a surprise. It is surprising though that there still doesn’t seem to be widespread alarm about the dangers to democracy these tools pose…
"ChatGPT, the most heavily used AI service, gave wrong information in 46% of its answers, including making up an expenses scandal, giving inaccurate replies on voter eligibility rules and getting the date of the election wrong by two months."
www.theguardian.com/technology/2...
This is particularly worrying: “Use is widespread and growing: 1 in 5 adults (20%) report using an AI chatbot or AI search service to find information about the local and devolved elections in the run up to May 7th – that’s equivalent to over 10 million UK adults” - demos.co.uk/research/ele...
Good piece by Jefferson Pooley on how LLM-powered “research” tools like Google’s “Deep Research” and Elsevier’s “AI Discovery” likely strengthen the “Matthew effect”: highly-cited authors are amplified while undercited (often female) authors are increasingly ignored: blogs.lse.ac.uk/impactofsoci...
Good piece by Jefferson Pooley on how LLM-powered “research” tools like Google’s “Deep Research” and Elsevier’s “AI Discovery” likely strengthen the “Matthew effect”: highly-cited authors are amplified while undercited (often female) authors are increasingly ignored: blogs.lse.ac.uk/impactofsoci...
I don’t agree though with his conclusion that these tools are popular because the summaries are “good” (despite hallucinations). The summaries are not good enough for academic use. They overgeneralise and contain alarming amounts of subtle hallucinations, which are harder to spot than obvious ones
I desire more in life than to be the “don’t summarise with AI”-guy on bluesky 😅 but reports like this keep coming in, so I’ll repeat ad nauseam, don’t summarise with ‘AI’! www.tue.nl/en/our-unive...
The fact that the Ontario government recommended AI summary systems with such obvious and potentially patient-harming flaws should give pause to any doctors (or their patients) making use of them.
this graduation speech moment is notable, and her amazed shock at having failed to read the room feels instructive.
when you're inside the bubble, you think everybody else is. but everybody isn't.
Meet the academics refusing to use generative AI
Researchers say they have their reasons for avoiding AI tools — and they’re sick of arguing about it.
www.nature.com/articles/d41...
h/t @maartenp.bsky.social
The world is now so full of ridiculous things that I struggle to deal with it all. But this is not an 'us' problem. The world really is idiotic. I made a list of things that are impossible to believe. Seeing it in writing might help you deal better with the situation. berthub.eu/articles/pos...
This is a story about power, about politicians becoming distracted by a shiny new thing, without stopping to ask what it might cost.
www.newstatesman.com/technology/2...
Wanneer weet je dat de periode die je beschrijft de geschiedenis zal veranderen en wanneer weet je zeker dat iets een voetnoot zal blijken te zijn?
Na 7,5 jaar stop ik als politiek verslaggever. Lees hier mijn afscheidsstuk: www.nrc.nl/nieuws/2026/...
Zijn dit bewegende beelden van Den Uyl of een met (GenAI) geanimeerde foto? En de foto van Aletta Jacobs (de foto op haar Wikipedia-pagina) lijkt ook te bewegen. Als het GenAI is dan is dat heel jammer en onnodig, wat mij betreft.
in the end where claude gives him an answer on moratoriums that he doesn’t like, so he pushes back and it gives him the answer he wants is a pretty pure example of the reinforcement bias and sycophancy we talk about with chatbots, but you get the impression he convinced claude he was actually right
Google is now screwing with the 10 blue links in traditional search and rewriting headlines - including ours - to be the worst kind of slop. This sucks so bad www.theverge.com/tech/896490/...
Almost daily reports now on how AI-generated summaries are wreaking havoc in academia, journalism, law, and elsewhere. Today, how a prominent Belgian journalist wrote 15 articles containing fake quotes, taken from AI summaries (in Dutch): www.nrc.nl/nieuws/2026/...
The journalist: “I underestimated the power of hallucinations”
Another passage: “AI output is often close to the truth. This was also the case with these citations.” Assistant professor Hannes Cools: “Still, there is a fundamental difference between the truth, and close to the truth.”
Never use GenAI tools to summarise or verify information. It’s unreliable and will introduce misinformation into the public sphere, muddying discussions. www.theguardian.com/global-devel...