Decent reading list for what appears to be current meta for training frontier models
A new post-training paradigm is emerging called Multi-Teacher On-Policy Distillation (MOPD), where one model learns from multiple specialized RL teachers. Already used in models like Kimi K3 and DeepSeek-V4, we compiled some key papers tracing its developments. www.alphaxiv.org/shared/folde...
0 reposts1 like