Why didn't Anthropic do effective false positive rejection with their Mythos/Glasswing vuln reports? In danluu.com/ai-coding/#m..., I mentioned a colleague finding that the reports we got were mostly false. That seems common? E.g., gregkh on kernel reports and www.vulncheck.com/blog/anthrop...
Post
At the time, I was doing automated bug finding with human review. Human review found zero known false positives in the bugs I filed. Anthropic was using a better model and had more tokens to spend, which gave them the advantage on the two most difficult factors w.r.t. false positive rejection.
0 reposts6 likes
No replies yet.