Tim Duffy on Mythryl: “Please forgive me I posted benchmark scores without confidence…”

Please forgive me I posted benchmark scores without confidence intervals. Here's an updated chart with a 90% CI using Qwen3-32B as reference.

Tim Duffy@timfduffy.com

Epoch's ECI has limited coverage of small models, so I had Claude scrounge up benchmarks for a bunch of them and fit an index using the ECI code. Here are scores for Qwen models. I recommend taking the low end model scores with a grain of salt, they are based on only a few benchmarks. Qwen3.5...

16/8/26, 7:49 pm0 reposts9 likes

Post