Post

p sure folk here will hate this, but i think that open models above a certain strength (Mythos level??) should indeed be restricted access below that threshold i’m all in on open models, but above leads to some serious social risks idk maybe i’ll think different after significant diffusion

Ensuring dangerous capabilities are restricted (eg how to make a nuke) is a good thing, but in regard to LLMs it is a slippery slope. LLM capabilities are jagged. Meaning that Mythos might be paramount at cybersecurity, but it not be dangerously good at something else. Where do we draw the line?

i agree that it’s a slope, and i also think you can go partway down a slope without sliding to the bottom it feels strange to argue that we shouldn’t be able to stop an in-progress crime. That feels like a pretty clear trade-off