2026-11-16 · America/Los_Angeles · 论文 · #18
WebArena-Pro: A Heterogeneous, Multimodal, Reproducible Benchmark for Web Agents
Web agents powered by large language and vision-language models are increasingly applied to realistic browser work that spans heterogeneous applications, multimodal content, and stateful workflows. However, existing reproducible web-agent benchmarks cover only a small number of web applications drawn from a few software categories, and restrict modality to text and vision. Live benchmarks broaden site coverage but sacrifice reproducibility, since pages and data drift between runs. Moreover, existing benchmarks do not meaningfully evaluate whether agents can understand and use audio and video…
热度 39.1 / 100;排名与评分保留该期记录。