Post

Flo 🔶
@faz.ms

While I'm mostly watching mech interp from the sidelines and don't have enough insight to judge how big of a deal this really is, I appreciated it as an insight into how far the field has gotten and what success might look like. Still, I think it merits a slopcore video: youtu.be/R9T_IxI1AIs

youtu.beAlready CleanYouTube video by Florian AZ
ellie lockhart (she/they)@eleanor.lockhart.contact

strongly recommend reading this, regardless of whether you’re an AI fan,skeptic, user, whatever. Among other things, this has a diagram of a Mixture of Experts model (one of the common LLM architectures) that really elegantly shows both how it works and also demystifies it already-clean.goodfire.com

already-clean.goodfire.comNeural Networks Are Already CleanA working hypothesis about neurons, generalization, and the ecology of circuits.

0 reposts2 likes