Post

We're excited to share bluffbench2, a next-generation data science LLM evaluation. The eval measures how well models notice subtle data quality issues in plots. Even the most capable models today score in the mid-teens. opensource.posit.co/blog/2026-07...

opensource.posit.coAI Newsletter: LLMs often miss subtle visual artifacts in data visualizationsIntroducing bluffbench2, a new data science LLM evaluation.

17/7/26, 4:44 pm6 reposts29 likes

Timur Ludanov

@timur.ludanov.dev

14 Sept

This is a great reminder that broad benchmarks can hide the hardest parts of real workflows. Task-specific evaluations are so valuable for uncovering these subtle failure modes.