Post

Ed
@ed3d.net

quick question how do you do distillation without RL

Quantian@quantian.bsky.social

The only competitive Chinese model is GLM because they are focusing on RL rather than distillation in order to develop powerful cyber capabilities and as a result they might get, like, literally sanctioned if they release an open source cyber weapon so idk how long that continues

Ed
@ed3d.net

for the unfamiliar: that is a live dashboard that charted the reinforcement learning logs of a Xiaomi model that, for whatever you think of the "Pareto frontier", leads it in its category

Ed
@ed3d.net

in its category on artificialanalysis, that is, for whatever those benchmarks remain good for anyway, should the takeaway here be that Anthropic sucks at making models or that China is not simply stealing America's homework

2 reposts19 likes

No replies yet.