Researcher in ML/NLP at the University of Edinburgh (faculty at Informatics and EdinburghNLP), Co-Founder/CTO at www.miniml.ai, ELLIS (@ELLIS.eu) Scholar, Generative AI Lab (GAIL, https://gail.ed.ac.uk/) Fellow -- www.neuralnoise.com, he/they
my amazing collaborators will be presenting a few papers at EMNLP/NeurIPS/LoG -- if you're attending any of these conferences, touch base with them; they're great! 🚀🚀🚀
blog post: neuralnoise.com/2026/emnlp-n...
1/5 My colleagues and collaborators will present a few papers at NeurIPS later this year! 🚀
Self-play for open-ended tasks, non-literal retrieval heads, shortcuts in multimodal benchmarks, and a psychophysics-based approach to AI evaluation.
A quick tour below. Blog post underway!
5/5 With Jonas Müller, Dario Zanca and collaborators: grounding AI behavioural evaluation in psychophysics.
We propose psychometric functions and Marr's levels to distinguish task performance, representations and implementation.
Preprint coming soon!
1/5 My colleagues and collaborators will present a few papers at NeurIPS later this year! 🚀
Self-play for open-ended tasks, non-literal retrieval heads, shortcuts in multimodal benchmarks, and a psychophysics-based approach to AI evaluation.
A quick tour below. Blog post underway!
2/5 SCOPE, led by Wai-Chung Kwan, with @aryopg.bsky.social: a Challenger creates document-grounded tasks, a Solver learns through retrieval, and a frozen self-judge rewards answers.
Up to +10.4 points on open-ended benchmarks, without curated prompts.
https://arxiv.org/abs/2605.31433
The CFP for the Student Research Workshop at #EACL2027 is up!
🔗 2027.eacl.org/calls/srw/
⏰ Pre-submission mentorship deadline: Nov 6, 2026
⏰ Direct paper submission deadline: Dec 15, 2026
We accept both PhD thesis proposals and regular #nlproc research papers, looking forward to your submissions!
I still believe that everyone is too fixated on the state of play in AI right now (which labs are ahead, how to manage costs, etc.) and not focused enough on the continued steepness of the capability curve for AI
At higher capabilities (like the ones expected in the near term), a lot changes fast.
Organisations -- sponsorship opportunities are available for #EACL2027, the flagship European conference in computational linguistics, taking place in Athens in March 2027! Support the NLP community and connect with researchers and practitioners: 2027.eacl.org
Thrilled to have been awarded the Association for Computational Linguistics 2016 test of time award for my first ever paper, written with/under the guidance of @dirkhovy.bsky.social
A couple of cute things about the paper/its genesis/its outcomes
New blog post on our {ICML, ACL} 2026 papers, plus some new interesting results on open-ended learning and multi-modal retrieval!
neuralnoise.com/2026/icml-ac...
Call for papers for special issue on Ethics in NLP in the journal Computational Linguistics.
Discussions around ethics in #NLP and #ComputationalLinguistics is often limited by the expectations for what should be published in *CL conferences.
Link to call: www.aclweb.org/portal/conte...
NLP reviews suck! But why is not clear– @aclrollingreview.bsky.social provides *a lot* of guidance for how to review, but in that, first principles get lost. So @adamlopez.bsky.social and I have written down some of our thoughts on first principles.
Attention #NLProc researchers, the EACL 2027 website is officially LIVE: 2027.eacl.org! 🎉
🇬🇷 Join us in Athens, Greece (Mar 9-13, 2027) at #EACL2027
📅 ARR submission deadline: Aug 6, 2026. Open to all areas of CL/NLP + related fields. Stay tuned for the detailed CfP soon!
If you are interested in privacy-preserving clinical NLP, we are recruiting a postdoc at the University of Edinburgh! The work is on LLMs/VLMs, AI privacy, and real-world health data in secure research environments.
Apply by April 6th, 2026!
More details: elxw.fa.em3.oraclecloud.com/hcmUI/Candid...
We are advertising a postdoc position to work on #generative#models, #structure#induction, and MI #estimation with Michael Gutmann as part of @genaihub.bsky.social !
elxw.fa.em3.oraclecloud.com/hcmUI/Candid...
Get in touch! (#ML #AI)
👉 homepages.inf.ed.ac.uk/snaraya3/
👉 michaelgutmann.github.io
Motif 2.6B — compact model with long context
unique: trained on AMD GPUs
focus is on long context & low hallucination rate — imo this is a growing genre of LLM that enables new search patterns
huggingface.co/Motif-Techno...
@togelius.bsky.social has thoughts on Genie 3 and games togelius.blogspot.com/2025/08/geni...
Fairly close to my own, though I didn't get the preview the tech.
Walking around a generated image-to-image world is not the same as playing a game. There are no game objectives.
Anthropic research identifies “inverse scaling in test-time compute,” where longer reasoning degrades AI performance. On certain tasks, models become more distracted by irrelevant data or overfit to spurious correlations.
#MLSky
Hm, hard disagree here. I really fail to see how this is misconduct akin to bribery, it's just a defense mechanism against bad reviewing practices. @neuralnoise.com
🚨 New Paper 🚨
How effectively do reasoning models reevaluate their thought? We find that:
- Models excel at identifying unhelpful thoughts but struggle to recover from them
- Smaller models can be more robust
- Self-reevaluation ability is far from true meta-cognitive awareness
1/N 🧵
Inverse scaling of reasoning models
a research collab demonstrated that there are certain types of tasks where all top reasoning models do WORSE the longer they think
things like getting distracted by irrelevant info, spurious correlations, etc.
www.arxiv.org/abs/2507.14417
Reasoning is about variable binding. It’s not about information retrieval. If a model cannot do variable binding, it is not good at grounded reasoning, and there’s evidence accruing that large scale can make LLMs worse at in-context grounded reasoning. 🧵
This essay by Nisheeth Vishnoi is a thoughtful meditation on the nature of science and a rebuttal to the notion that AI systems are going replace human scientists anytime soon. Worth reading.
nisheethvishnoi.substack.com/p/what-count...
Preprint alert 🎉 Introducing the Agentic eXplanations via Interrogative Simulations (AXIS) algo.
AXIS integrates multi-agent simulators with LLMs by having the LLMs interrogate the simulator with counterfactual queries over multiple rounds for explaining agent behaviour.
arxiv.org/pdf/2505.17801
'AI Safety for Everyone' is out now in @natmachintell.nature.com! Through an analysis of 383 papers, we find a rich landscape of methods that cover a much larger domain than mainstream notions of AI safety. Our takeaway: Epistemic inclusivity is important, the knowledge is there, we only need use it
Can you train a performant language model using only openly licensed text?
We are thrilled to announce the Common Pile v0.1, an 8TB dataset of openly licensed and public domain text. We train 7B models for 1T and 2T tokens and match the performance similar models like LLaMA 1 & 2
COLM (@colmweb.org) reviewers, please follow up on author responses if you need to! Most of the papers in my area chair batch didn't receive reviewer follow-ups, and it's dire
claude-code is pretty good at updating personal websites! it has browser use, so it can e.g. scrape your latest papers from arxiv and dblp and use that to update your website's publication list
🗓️ Deadline extended: 💥2nd June 2025!💥
We are looking forward to your works on:
🔌 #circuits and #tensor#networks 🕸️
⏳ normalizing #flows 💨
⚖️ scaling #NeSy#AI 🦕
🚅 fast and #reliable inference 🔍
...& more!
please share 🙏
the #TPM ⚡Tractable Probabilistic Modeling ⚡Workshop is back at @auai.org#UAI2025!
Submit your works on:
- fast and #reliable inference
- #circuits and #tensor#networks
- normalizing #flows
- scaling #NeSy#AI
...& more!
🕓 deadline: 23/05/25
👉 tractable-probabilistic-modeling.github.io/tpm2025/
We propose Neurosymbolic Diffusion Models! We find diffusion is especially compelling for neurosymbolic approaches, combining powerful multimodal understanding with symbolic reasoning 🚀
Read more 👇
We propose Neurosymbolic Diffusion Models! We find diffusion is especially compelling for neurosymbolic approaches, combining powerful multimodal understanding with symbolic reasoning 🚀
Read more 👇