Strong disagree -this paper is good and I think the extremely talented PhD student that authored it should be proud - she has a bright future ahead of her in science. Pulling ML into a more rigorous paradigm of annotation is what we need much more of - this paper helps that cause.
Treading lightly because I'm happy to see data annotation discussions happening anywhere. But I'm also incredibly frustrated that the AI/ML world seems to be happy ignoring literal *decades* of work on this topic. From a recently published paper in AAAI/ACM that has tipped me over into despair fr