Maarten Paulusse

Maarten Paulusse

@maartenp.bsky.social

information literacy & education specialist | studied and taught history, american studies, and religious studies

364 followers364 following61 posts

Pinned

Tired of AI hype posts? You might like my sober assessment of whether AI-generated summaries are suitable for studying and research. Spoiler alert, they are not. The text is primarily aimed at students and researchers, but has much broader relevance. So share freely!: www.tue.nl/en/our-unive...

tue.nlAre AI-generated summaries suitable for studying and research?Despite didactic, ethical, and environmental concerns, the use of GenAI is on the rise in academia. For most applications, the jury is still out on whether and how they will benefit education and rese...

Maarten Paulusse reposted

Maarten Paulusse reposted

Replying to @olivia.science

Third, automating science is not really possible in the way described. In the same way a machine cannot eat food for us because we'd starve: scientific understanding is for us to experience and share with others as a psychological state. It's a process and a cognitive state not an output.

It's not like biology has a single definition for life — nor do they need a definite meaning to start work. The whole point of science is the understandings produced by the work: that's what knowledge production is. You don't put definitions in and out comes something else. You toil to understand.

Maarten Paulusse reposted

Was reminded of this by someone's questions to me about how to argue against the (common) claim that LLMs can "summarize", so reboosting as a gentle reminder for you all too

Iris van Rooij 💭@irisvanrooij.bsky.social

Using LLMs in science for “literature review” or “summarizing" is *automated cryptogyny* olivia.science/cryptogyny/ @olivia.science 🧵

View full thread

This means that when a university recommends a GenAI tool or even licenses it to their researchers or students (aspiring researchers), they need to show that the tool does not infringe on academic integrity principles by design. Will tools like ChatGPT and Claude pass that test? ⬇️

Companies like Anthropic and OpenAI are under scrutiny for copyright and human rights violations, unjust labor practices, unsustainable energy and water use, and the deployment of AI hacking systems. Can an academic use such a tool without breaching the Transparency and Responsibility principles?

In the duty of care section of the Code, universities are not only urged to make clear guidelines on how researchers can use AI in alignment with the Code but also what technologies align with it. ⬇️

Maarten Paulusse reposted

Dear @erc.europa.eu , we DO already have common standards & frameworks. 'AI' likes to pose itself as 'special' but we do not need to reinvent the wheel. We already have established codes of conduct for research integrity. We just need to apply them. See below + more resources in thread🧵

There is a need to agree on common standards & frameworks for AI models used across all aspects of research evaluation. These should ensure & encourage trust, confidentiality, & transparency, & should be defined through collaborative discussions between research funding and performing organisations.

We need libraries as safe havens for printed books more than ever… “…a copyright lawsuit from book authors against Anthropic revealed internal documents detailing its plan to obtain and scan millions of printed books, and destroy them in the process” www.404media.co/ai-companies...

404media.coAI Companies Are Buying Tons of Old Books Because They're Free of AI SlopISBNdb, a company that sources printed books for AI companies to turn into training data, tells clients “the optics problem is real.”

“This bookseller said his inventory is full of rare, foreign language, and low circulation books, meaning that if they are destroyed in the process of becoming training data, they’ll be even harder to obtain.”

Tech CEOs are promising us AI that will soon be as capable as humans (AGI). Some computer scientists are not convinced. Iris van Rooij has warned about the “intractability” of human-like computer systems for decades. We are now seeing signs LLMs are indeed already unscalable at levels far below AGI.

Iris van Rooij 💭@irisvanrooij.bsky.social

Entirely as expected (see link.springer.com/article/10.1...) --- “Epoch AI … published a graph last year … It shows the exponentially increasing costs of serving more “tokens”—the words users type to chatbots—with several public AI models.” article: archive.ph/IrNBI (h/t @maartenp.bsky.social)

Maarten Paulusse reposted

I'm attending a digital humanities event in Montreal. There was a keynote on AI and something about the talk made me wonder if it had been written by Claude. I said as much in the Q&A. As I posed the question, the speaker shifted, looking slightly uncomfortable. What he said next shocked the room +

Maarten Paulusse reposted

At the end of the term I asked my college creative wriing students to submit anonymous thoughts on AI. No real surprises: Mood ranges from resignation to despair, capitulation from embittered erosion of standards to total, feelings of betrayal from deep to furious. 1/

This is funny, because it confirms that LLM-powered chatbots are easily jailbroken (guardrails are a sham) and it makes Anthropic admit that despite their scaremongering hype marketing, Mythos is not some super hacker. It can spot simple, known exploits like any other model.

Kyle Orland@kyleor.land

Gotta say I was not expecting my World Cup watching to be interrupted by writing a story like this... arstechnica.com/ai/2026/06/a...

Maarten Paulusse reposted

Replying to @emilymbender.bsky.social

I guess I'll keep shouting this message from the rooftops until it sticks. Lumping disparate technologies under the ✨"AI"✨ label only inhibits clear discussion and reasoning about what each does. >>

Daarnaast klopt het ook niet dat verbeterde programmeer-“skills” van GenAI tools betekent dat ze ook op alle andere terreinen “slimmer” gaan worden. De LLM’s onder de motorkap kunnen nog steeds niet nadenken, hallucineren in het wilde weg en hun output blijft een op statistiek gebaseerde imitatie

Maarten Paulusse reposted

Al sinds september heb ik kanker. De ziekte is nu weg, maar om terugkeer te voorkomen of vertragen is een medicijn nodig dat voor mij niet wordt vergoed. Gelukkig zijn mijn vrienden een crowdfunding gestart. Alle donaties zijn welkom en delen helpt ook! www.gofundme.com/f/help-floor...

gofundme.comDonate to Help Floor aan een levensreddend kankermedicijn!, organized by Elizabeth PrinsLieve vrienden, familie, en alle lieve mensen, Dear English-speak… Elizabeth Prins needs your support for Help Floor aan een levensreddend kankermedicijn!

Once you have a basic understanding of how these LLM-powered chatbots work this shouldn’t be a surprise. It is surprising though that there still doesn’t seem to be widespread alarm about the dangers to democracy these tools pose…

Juliet E McKenna@julietemckenna.bsky.social

"ChatGPT, the most heavily used AI service, gave wrong information in 46% of its answers, including making up an expenses scandal, giving inaccurate replies on voter eligibility rules and getting the date of the election wrong by two months." www.theguardian.com/technology/2...

This is particularly worrying: “Use is widespread and growing: 1 in 5 adults (20%) report using an AI chatbot or AI search service to find information about the local and devolved elections in the run up to May 7th – that’s equivalent to over 10 million UK adults” - demos.co.uk/research/ele...

demos.co.ukElectoral Hallucinations: Safeguarding UK elections in the world of LLMs and AI chatbotsDemos is Britain’s leading cross-party think-tank. We produce original research, publish innovative thinkers and host thought-provoking events.

Good piece by Jefferson Pooley on how LLM-powered “research” tools like Google’s “Deep Research” and Elsevier’s “AI Discovery” likely strengthen the “Matthew effect”: highly-cited authors are amplified while undercited (often female) authors are increasingly ignored: blogs.lse.ac.uk/impactofsoci...

blogs.lse.ac.ukThe Matthew effect in AI summary - LSE ImpactAI research tools are trained on a literature that is structured by an unequal distribution of attention. Does their use simply recreate these biases ?

Good piece by Jefferson Pooley on how LLM-powered “research” tools like Google’s “Deep Research” and Elsevier’s “AI Discovery” likely strengthen the “Matthew effect”: highly-cited authors are amplified while undercited (often female) authors are increasingly ignored: blogs.lse.ac.uk/impactofsoci...

blogs.lse.ac.ukThe Matthew effect in AI summary - LSE ImpactAI research tools are trained on a literature that is structured by an unequal distribution of attention. Does their use simply recreate these biases ?

I don’t agree though with his conclusion that these tools are popular because the summaries are “good” (despite hallucinations). The summaries are not good enough for academic use. They overgeneralise and contain alarming amounts of subtle hallucinations, which are harder to spot than obvious ones

I desire more in life than to be the “don’t summarise with AI”-guy on bluesky 😅 but reports like this keep coming in, so I’ll repeat ad nauseam, don’t summarise with ‘AI’! www.tue.nl/en/our-unive...

tue.nlAre AI-generated summaries suitable for studying and research?Author: Maarten Paulusse Despite didactic, ethical, and environmental concerns, the use of GenAI is on the rise in academia. For most applications, the jury is still out on whether and how they will b...
Ars Technica@arstechnica.com

The fact that the Ontario government recommended AI summary systems with such obvious and potentially patient-harming flaws should give pause to any doctors (or their patients) making use of them.

Maarten Paulusse reposted

this graduation speech moment is notable, and her amazed shock at having failed to read the room feels instructive. when you're inside the bubble, you think everybody else is. but everybody isn't.

Maarten Paulusse reposted

The world is now so full of ridiculous things that I struggle to deal with it all. But this is not an 'us' problem. The world really is idiotic. I made a list of things that are impossible to believe. Seeing it in writing might help you deal better with the situation. berthub.eu/articles/pos...

berthub.euThe Impossible Things We Have to Believe - Bert Hubert“Alice laughed. ‘There’s no use trying,’ she said. ‘One can’t believe impossible things.’ I daresay you haven’t had much practice,’ said the Queen. ‘When I was your age, I always did it for half-an-ho...

Maarten Paulusse reposted

Zijn dit bewegende beelden van Den Uyl of een met (GenAI) geanimeerde foto? En de foto van Aletta Jacobs (de foto op haar Wikipedia-pagina) lijkt ook te bewegen. Als het GenAI is dan is dat heel jammer en onnodig, wat mij betreft.

Progressief Nederland@progressiefned.bsky.social

Welkom thuis bij Progressief Nederland.

Maarten Paulusse reposted

Replying to @parismarx.com

in the end where claude gives him an answer on moratoriums that he doesn’t like, so he pushes back and it gives him the answer he wants is a pretty pure example of the reinforcement bias and sycophancy we talk about with chatbots, but you get the impression he convinced claude he was actually right

Almost daily reports now on how AI-generated summaries are wreaking havoc in academia, journalism, law, and elsewhere. Today, how a prominent Belgian journalist wrote 15 articles containing fake quotes, taken from AI summaries (in Dutch): www.nrc.nl/nieuws/2026/...

nrc.nlHoe een journalist uitglijdt op door AI verzonnen citatenGebruik van AI-programma’s als ChatGPT als schrijfassistent leidt regelmatig tot missers. Na incidenten in media, wetenschap en advocatuur, ging nu ook journalist Peter Vandermeersch in de fout. „Ik h...

The journalist: “I underestimated the power of hallucinations” Another passage: “AI output is often close to the truth. This was also the case with these citations.” Assistant professor Hannes Cools: “Still, there is a fundamental difference between the truth, and close to the truth.”