2026-10-25 · America/Los_Angeles · 论文 · #19
Async-RBench: Benchmarking Asynchronous Task Execution in LLM Agents
Large language model (LLM) agents increasingly execute tasks asynchronously: a main agent continues working while its subagents run, and the task state may change before their results arrive. The main agent must decide which work to update or preserve and which checks to repeat, while avoiding prohibited changes. Final task success alone does not reveal whether these results were handled correctly, and natural asynchronous arrivals are hard to reproduce. We introduce Async-RBench, a benchmark for asynchronous task execution in LLM agents, with 200 executable tasks covering eight scenarios. A…
热度 14.0 / 100;排名与评分保留该期记录。