Code diffs aren't the only measure of agent quality. Efficiency matters too! Ex: We found agents spinning their wheels working around problems in our test harness. This silently wasted hundreds of tool calls in aggregate. I presented a system to detect this at AI Engineer
0 reposts9 likes