Raphaël Merx@rapha.devWhoa the #WMT25 results on MT Evaluation are wild! ChrF outperforms pretty much all neural metrics 🙀18/10/25, 5:17 am·0 reposts·0 likes
Raphaël Merx@rapha.dev18 Oct 2025They say it's because (1) test sets have become more challenging, (2) include more lang pairs, (3) are longer, and (4) used ESA instead of MQM. But we need an ablation study!1
Raphaël Merx@rapha.dev18 Oct 2025the paper www2.statmt.org/wmt25/pdf/20...www2.statmt.orgwww2.statmt.org