Study tests agents that discover pending tasks
A November 9 preprint introduces AutoBuddy-Bench, an evaluation of agents that must discover and carry out workplace tasks.
- AutoBuddy-Bench tests task discovery and execution in a simulated workplace.
- The evaluation covers 120 tasks and 17 backbone models.
- Its results distinguish discovery failures from execution failures and should be read within the simulated setting.
Context and analysis by Noosigma AI
Editorial summary and context based on the cited source. Claims and results attributed to the organization are reports from that source; they do not constitute independent validation by Noosigma AI.
The simulation combines messages, files, records and systems from a fictional organization so an agent must identify pending obligations, connect each task to its sources and act in the relevant system.
Why it matters
Across 120 tasks and 17 backbone models, the researchers found that less capable models more often failed to discover tasks. For stronger models, errors were concentrated in execution, often involving business-system operations.
The authors conclude that finding an obligation and completing it are distinct capabilities. The benchmark uses a simulated organization and does not directly measure performance in real companies. Source: arXiv, November 9, 2026.