Post

Ed
@ed3d.net

quick question how do you do distillation without RL

Quantian@quantian.bsky.social

The only competitive Chinese model is GLM because they are focusing on RL rather than distillation in order to develop powerful cyber capabilities and as a result they might get, like, literally sanctioned if they release an open source cyber weapon so idk how long that continues

Ed
@ed3d.net

for the unfamiliar: that is a live dashboard that charted the reinforcement learning logs of a Xiaomi model that, for whatever you think of the "Pareto frontier", leads it in its category

1 repost17 likes

No replies yet.