I found this refreshingly honest and forthright statement about AI use in a recent paper! IMO this is exactly the right way to do it. ieeexplore.ieee.org/document/115...
Neil Traft
Neil Traft
@ntraft.bsky.social
PhD student at the Vermont Complex Systems Institute. Interested in ML, evolution, self-organization, & collective intelligence. http://ntraft.com https://t.co/ja3fdtRLdM
442 followers260 following292 posts
Neil Traft reposted
I’m starting a blog! My first post is on how 3rd party embedded evaluators seem totally unsuited to addressing the problems we are currently facing, and what the real problem is. stellabiderman.ai/blog/embedde...
I just had an odd thought: AI "alignment" is like the Halting Problem. Alignment at model training time is obviously not possible, in the same way that a halting decider is not possible: you can't magically know ahead of time whether or not an algorithm will "make a boo-boo".
I was quite bothered that Huggingface didn't sue or seek reparations or anything (afaik?) upon the original event. It's so backwards to think we can guarantee security at model training time (a.k.a. alignment), rather than at deployment time. Security can only come from making ppl accountable.
Neil Traft reposted
Screw-ups should be costly. There should be a high government fine on top of it, plus paying to clean-up and re-secure the systems hacked. These are equivalent to industrial accidents and should be treated as such, imo
"Oh, poor thing, it's costing you *money* to go through the unacceptable mess you have created, unprompted, out of sheer negligence?" www.theguardian.com/technology/2...
Neil Traft reposted
Modifying an NCA phenotype with LoRA adapters (showing there are low-dimensional modifications that can scale/skew the resulting image). Bringing together two of my favorite AI concepts, NCAs and PEFT (parameter efficient fine-tuning). 🙂
new #preprint: t.co/eE1qqGSflK Ben Hartl explains: In 1917, D'Arcy Thompson drew Cartesian grids around different anatomical shapes & showed that deforming the grid could change one species' shape into that of another. We find that "reusable regulatory handles control phenotypic variation" in NCAs
Neil Traft reposted
In our Nature paper, we introduce the first superhuman Stratego AI, which we built using general techniques that we developed for RL & test-time compute under imperfect information. www.nature.com/articles/s41...
Neil Traft reposted
Neil Traft reposted
"Despite the seemingly novel power these tech oligarchs wield in the space sector, their position today does not reflect a break from the space industry of the past but is a direct result of foundational decisions made at the origins of the US space programme." www.tandfonline.com/doi/full/10....
"According to the tenets of rational choice theory, you can answer [any question] by forecasting a dollar value and probability of every outcome. … This is ludicrous if you think about it for two seconds. And yet it’s become a standard social convention..." www.argmin.net/p/pricing-co...
Neil Traft reposted
Happy New Year! Here's some microorganism porn. vimeo.com/1024357218 (srsly though. it's mesmerizing.)
Neil Traft reposted
Fascinating story: 1. Fear-mongering about peanut allergies multiplies in the late 90s. 2. AAUP advises "no peanuts til age 3", despite NO evidence. 3. This advice CAUSES a massive spike in peanut allergies! 4. They had to do a large study just to undo the damage & convince everyone it was safe!
The LEAP RCT on peanut allergies: A randomized trial in which equipoise arose from parental anxiety, not scientific uncertainty.
Neil Traft reposted
This is a travesty!! Also I have questions... for the branches that aren't terminated, where will they move? Will they be in the same building, under a different name? In which case, will it all be functionally the same thing (but with lots of political disruption)?
It is hard to overstate how critical @ncar-ucar.bsky.social is to climate science in the US and around the world. It's the beating heart of our field. Generations of scientists have trained there, and almost everyone I know relies on deep collaborations with NCAR scientists. It's end is unthinkable.
From David Krakauer's introduction to the Foundational Papers in Complexity Science. www.foundationalpapersincomplexityscience.org
Neil Traft reposted
In applying AI to material science, biology, etc, capitalism is trying to shed science. The point is to substitute the engineering of a machine that can generate what science has hitherto done, but without having people know things. Knowledge ultimately residing in private property is the dream.
I thought this was a fascinating way to motivate model merging: to be able to *interpolate* between model classes, rather than be forced into discrete choices. (models trained on different datasets, models of different sizes, etc.) "Interpolation and alignment are two sides of the same coin."
Did you know that you could create hybrids across different neural net architectures—*without* updating the weights?? Come check out my poster at the UniReps @unireps.bsky.social workshop at 3:45pm today at #NeurIPS! (Or you can already browse the posters on the wall in 20D throughout the day.) 😃
I’ll have a poster at @unireps.bsky.social 🔵🔴 It’s a terrific workshop at the intersection of neuroscience and DL: across both biological and artificial NNs, how can we measure / compare / align / merge neural representations? Should be fascinating! Check it out if you're around! unireps.org/2025
Link to the full paper: openreview.net/pdf?id=e4wKQ... I think there's a lot of very interesting potential applications of "model stitching". Have a look. Plus, you get to feel like a mad scientist. IT'S ALIVE!
Neil Traft reposted
Check out our new work on using low-rank perturbations to make evolution strategies work for billion-parameter models.
Introducing 🥚EGGROLL 🥚(Evolution Guided General Optimization via Low-rank Learning)! 🚀 Scaling backprop-free Evolution Strategies (ES) for billion-parameter models at large population sizes ⚡100x Training Throughput 🎯Fast Convergence 🔢Pure Int8 Pretraining of RNN LLMs
Neil Traft reposted
What an incredible tool! I think I'll be returning to this a lot over the next month! The most interesting papers might be the ones that seem misclassified or out of place...
Inside NeurIPS 2025: The Year’s AI Research, Mapped New blog post! NeurIPS 2025 papers are out—and it’s a lot to take in. This visualization lets you explore the entire research landscape interactively, with clusters and @cohere.com LLM-generated explanations that make it easier to grasp.
It's too easy to write garbage survey papers and get lots of citations. Over time, I've learned to ignore most survey papers and recognize some markers of quality.
ArXiv has not had an explicit policy on survey papers. In CS we have recently adopted the same policy of requiring successful peer review prior to release. This is because we are inundated with LLM slop surveys intended to boost citation counts.
Neil Traft reposted
The blog post is available: blog.arxiv.org/2025/10/31/a...
Arxiv has long had a policy of not releasing opinion pieces (which covers a substantial fraction of position papers). We lack the moderation capacity to assess the quality of individual position papers, so we recently adopted a policy of requiring all such papers to pass peer review first.
Neil Traft reposted
It's been 8 months since I notified @springernature.com of a clear-cut case of fake references in a book chapter which they published. They have still not taken any action as they claim to still be investigating. I will not review for Springer again until this matter is satisfactorily resolved.
Neil Traft reposted
UBC’s department of Computer Science invites applications for up to 2 full-time tenure-track positions. The department is particularly interested in researchers in: visualization, robotics, reinforcement learning, data management, and data mining. @cs.ubc.ca science.ubc.ca/about/careers
Neil Traft reposted
This year's ALICE guest speakers 🧑🔬 - Angel Goñi-Moreno - @angelgm.bsky.social - Alyssa Adams - @alyssa-m-adams.bsky.social - Alexander Mordvintsev - Eric Medvet - @ericmedvetts.bsky.social - Kyrre Glette - @kyrre2000.bsky.social - Stefano Nichele - @stenichele.bsky.social - Susan Stepney
"Consider another human difference: financial solvency, which can be measured and quantified, just like IQ. It is heritable in twin studies and (less so) in SNPs. But would you bet that sooner or later we are going to know 'what’s going on' with your bank account at the level of genes?" Same for IQ.
In 2018, Charles Murray challenged me to a bet: "We will understand IQ genetically—I think most of the picture will have been filled in by 2025—there will still be blanks—but we’ll know basically what’s going on." It's now 2025, and I claim a win. I write about it in The Atlantic.
Neil Traft reposted
Q. Who aligns the aligners? A. alignmentalignment.ai Today I’m humbled to announce an epoch-defining event: the launch of the 𝗖𝗲𝗻𝘁𝗲𝗿 𝗳𝗼𝗿 𝘁𝗵𝗲 𝗔𝗹𝗶𝗴𝗻𝗺𝗲𝗻𝘁 𝗼𝗳 𝗔𝗜 𝗔𝗹𝗶𝗴𝗻𝗺𝗲𝗻𝘁 𝗖𝗲𝗻𝘁𝗲𝗿𝘀.
Neil Traft reposted
Merely a day after I call out OpenAI for being so closed (bsky.app/profile/ntra...), they release an open weights GPT. Glad they're finally reading my skeets! 😏
gpt-oss, OpenAI's open weights model 120B & 20B variants, both MoE with 4 experts active openai.com/index/introd...