Pasquale Minervini

Pasquale Minervini

@neuralnoise.com

Researcher in ML/NLP at the University of Edinburgh (faculty at Informatics and EdinburghNLP), Co-Founder/CTO at www.miniml.ai, ELLIS (@ELLIS.eu) Scholar, Generative AI Lab (GAIL, https://gail.ed.ac.uk/) Fellow -- www.neuralnoise.com, he/they

5.6K followers4.7K following188 posts

1/5 My colleagues and collaborators will present a few papers at NeurIPS later this year! 🚀 Self-play for open-ended tasks, non-literal retrieval heads, shortcuts in multimodal benchmarks, and a psychophysics-based approach to AI evaluation. A quick tour below. Blog post underway!

View full thread

5/5 With Jonas Müller, Dario Zanca and collaborators: grounding AI behavioural evaluation in psychophysics. We propose psychometric functions and Marr's levels to distinguish task performance, representations and implementation. Preprint coming soon!

1/5 My colleagues and collaborators will present a few papers at NeurIPS later this year! 🚀 Self-play for open-ended tasks, non-literal retrieval heads, shortcuts in multimodal benchmarks, and a psychophysics-based approach to AI evaluation. A quick tour below. Blog post underway!

Pasquale Minervini reposted

The CFP for the Student Research Workshop at #EACL2027 is up! 🔗 2027.eacl.org/calls/srw/ ⏰ Pre-submission mentorship deadline: Nov 6, 2026 ⏰ Direct paper submission deadline: Dec 15, 2026 We accept both PhD thesis proposals and regular #nlproc research papers, looking forward to your submissions!

2027.eacl.orgCall for Student Research Workshop PapersOfficial website for the 2027 Conference of the European Chapter of the Association for Computational Linguistics

Pasquale Minervini reposted

I still believe that everyone is too fixated on the state of play in AI right now (which labs are ahead, how to manage costs, etc.) and not focused enough on the continued steepness of the capability curve for AI At higher capabilities (like the ones expected in the near term), a lot changes fast.

Pasquale Minervini reposted

Attention #NLProc researchers, the EACL 2027 website is officially LIVE: 2027.eacl.org! 🎉 🇬🇷 Join us in Athens, Greece (Mar 9-13, 2027) at #EACL2027 📅 ARR submission deadline: Aug 6, 2026. Open to all areas of CL/NLP + related fields. Stay tuned for the detailed CfP soon!

My amazing colleagues Sid and Michael are looking for a postdoc! 👇

an-exlab.bsky.social@an-exlab.bsky.social

We are advertising a postdoc position to work on #generative #models, #structure #induction, and MI #estimation with Michael Gutmann as part of @genaihub.bsky.social ! elxw.fa.em3.oraclecloud.com/hcmUI/Candid... Get in touch! (#ML #AI) 👉 homepages.inf.ed.ac.uk/snaraya3/ 👉 michaelgutmann.github.io

Pasquale Minervini reposted

trend: non-NVIDIA training DeepSeek V3.1 was trained on Huawei Ascend NPUs this one is a South Korean lab training on AMD

mr. TIM@timkellogg.me

Motif 2.6B — compact model with long context unique: trained on AMD GPUs focus is on long context & low hallucination rate — imo this is a growing genre of LLM that enables new search patterns huggingface.co/Motif-Techno...

Pasquale Minervini reposted

@togelius.bsky.social has thoughts on Genie 3 and games togelius.blogspot.com/2025/08/geni... Fairly close to my own, though I didn't get the preview the tech. Walking around a generated image-to-image world is not the same as playing a game. There are no game objectives.

togelius.blogspot.comGenie 3 and the future of neural game enginesGoogle DeepMind just announced Genie 3 , their new promptable world model, which is another term for neural game engine. This is a big neura...

Pasquale Minervini reposted

Anthropic research identifies “inverse scaling in test-time compute,” where longer reasoning degrades AI performance. On certain tasks, models become more distracted by irrelevant data or overfit to spurious correlations. #MLSky

venturebeat.comAnthropic researchers discover the weird AI problem: Why thinking longer makes models dumberAnthropic research reveals AI models perform worse with extended reasoning time, challenging industry assumptions about test-time compute scaling in enterprise deployments.

Pasquale Minervini reposted

🚨 New Paper 🚨 How effectively do reasoning models reevaluate their thought? We find that: - Models excel at identifying unhelpful thoughts but struggle to recover from them - Smaller models can be more robust - Self-reevaluation ability is far from true meta-cognitive awareness 1/N 🧵

Pasquale Minervini reposted

Inverse scaling of reasoning models a research collab demonstrated that there are certain types of tasks where all top reasoning models do WORSE the longer they think things like getting distracted by irrelevant info, spurious correlations, etc. www.arxiv.org/abs/2507.14417

Pasquale Minervini reposted

Reasoning is about variable binding. It’s not about information retrieval. If a model cannot do variable binding, it is not good at grounded reasoning, and there’s evidence accruing that large scale can make LLMs worse at in-context grounded reasoning. 🧵

Pasquale Minervini reposted

Preprint alert 🎉 Introducing the Agentic eXplanations via Interrogative Simulations (AXIS) algo. AXIS integrates multi-agent simulators with LLMs by having the LLMs interrogate the simulator with counterfactual queries over multiple rounds for explaining agent behaviour. arxiv.org/pdf/2505.17801

Pasquale Minervini reposted

'AI Safety for Everyone' is out now in @natmachintell.nature.com! Through an analysis of 383 papers, we find a rich landscape of methods that cover a much larger domain than mainstream notions of AI safety. Our takeaway: Epistemic inclusivity is important, the knowledge is there, we only need use it

Pasquale Minervini reposted

Can you train a performant language model using only openly licensed text? We are thrilled to announce the Common Pile v0.1, an 8TB dataset of openly licensed and public domain text. We train 7B models for 1T and 2T tokens and match the performance similar models like LLaMA 1 & 2

claude-code is pretty good at updating personal websites! it has browser use, so it can e.g. scrape your latest papers from arxiv and dblp and use that to update your website's publication list

Pasquale Minervini reposted

🗓️ Deadline extended: 💥2nd June 2025!💥 We are looking forward to your works on: 🔌 #circuits and #tensor #networks 🕸️ ⏳ normalizing #flows 💨 ⚖️ scaling #NeSy #AI 🦕 🚅 fast and #reliable inference 🔍 ...& more! please share 🙏

antonio vergari ⚔️ short-circuiting@nolovedeeplearning.bsky.social

the #TPM ⚡Tractable Probabilistic Modeling ⚡Workshop is back at @auai.org #UAI2025! Submit your works on: - fast and #reliable inference - #circuits and #tensor #networks - normalizing #flows - scaling #NeSy #AI ...& more! 🕓 deadline: 23/05/25 👉 tractable-probabilistic-modeling.github.io/tpm2025/

Pasquale Minervini reposted

We propose Neurosymbolic Diffusion Models! We find diffusion is especially compelling for neurosymbolic approaches, combining powerful multimodal understanding with symbolic reasoning 🚀 Read more 👇