Post

yeah, it definitely looks bad and will force openai to respond (good imo), but i find it highly unlikely that it materially improved their performance, but will be hella difficult to prove that

If a user uses the product with "Improve the model for everyone" turned on, that's what it's meant to do. Alpöge sure should have known that as an employee of a company whose products use a similar option. But I haven't seen anything indicating something like that played any role.

agree, but it would be appropriate for openai to acknowledge any contribution, especially if they plan on continuing work with the scientific community

0 reposts13 likes

Why would they claim it contributed if there's no evidence of it? And as far as scientific papers go, Alpöge & Buckmaster papers didn't seem to have been even published when OpenAI wrote theirs. Wouldn't it be more inappropriate if it would mean making false claims?

For all that I have seen, claiming there was contribution would be the same as claiming they had inappropriate inside information about how their product was used (like knowing if that setting was on) or their product being faulty (if it wasn't).

It would be inappropriate also for the reason that we don't know how many others have used their product like that e.g. for trying to solve the same thing. Some of those other attempts might have had larger effect on weights. So they could list contributions from wrong people based on assumptions.

Which they basically already said there isn't.

Pekka Lund@pekka.bsky.social

"While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models⁠. However, our proofs differ significantly and even the precise results proved are different in the Euler case (forced vs unforced)."