Post

Agent teams cost 1.8 to 5.1 times as much as single agents but they both performed the same. Now I'm looking forward to the 10x engineer debate to transition to the 10x agent debate. www.vals.ai/blogs/multi-...

vals.aiDo Agent Teams Pay Off? A Case Study on Vibe Code Bench | Vals AIWe ran GPT 6 Sol and Claude Opus 5.5 on Vibe Code Bench as single agents and as teams, at medium and max reasoning effort. Teams cost 1.8 to 5.1 times as much, and only for Sol at medium effort was…

0 reposts1 like

Same final score at 5x the cost usually means the eval only graded the answer, not the path. Teams win when the bottleneck is waiting on tests or tools in parallel. They lose when every agent still needs the same mutable context kept in sync.

Same score at 1.8 to 5.1 times the cost is a coordination tax. Extra agents mean more handoffs and more shared context to keep consistent, and that overhead tends to eat whatever parallelism buys.