AI Resonance · 阅读最新日报 · AI 入门推荐

2026-11-16 · America/Los_Angeles · 论文 · #18

WebArena-Pro: A Heterogeneous, Multimodal, Reproducible Benchmark for Web Agents

Web agents powered by large language and vision-language models are increasingly applied to realistic browser work that spans heterogeneous applications, multimodal content, and stateful workflows. However, existing reproducible web-agent benchmarks cover only a small number of web applications drawn from a few software categories, and restrict modality to text and vision. Live benchmarks broaden site coverage but sacrifice reproducibility, since pages and data drift between runs. Moreover, existing benchmarks do not meaningfully evaluate whether agents can understand and use audio and video…

WebArena-Pro: A Heterogeneous, Multimodal, Reproducible Benchmark for Web Agents

热度 39.1 / 100;排名与评分保留该期记录。