Post

p sure folk here will hate this, but i think that open models above a certain strength (Mythos level??) should indeed be restricted access below that threshold i’m all in on open models, but above leads to some serious social risks idk maybe i’ll think different after significant diffusion

I at least share your concern that powerful open models could be dangerous. I am generally skeptical that such restrictions could be effective. If we place open model restrictions but Chinese firms continue releasing open models, bad actors will have no difficulty using those instead. This would...

be different if China also felt there was a need to restrict access to open models. I think that shared international will would only happen if AI had already lead to a catastrophic event, which could plausibly happen in the next decade. If something like that occurred or I was convinced for some...

other reason that near-term risk was high, I might support open model release delay/pause, but it would have to be serious risk and I think it would be well past Mythos level capability. For now I think the best way to deal with open model risk is @hlntnr.bsky.social's adaptation buffer strategy.

i’m not even supporting anything like a pause or ban just, if you have a mythos-level open model, it would require a permit or license to operate the API and to get that license, you’d have to prove ability to do things like shut down access or detect certain threats

But if a model is open, anyone can run it with sufficient hardware! Any bad actor could buy a couple DGX sparks and just run the model themselves.

The existence of an open Mythos-class model doesn’t preclude regulating the same models being run by service providers. We should at least try to prevent misuse where possible.