AI Resonance · 阅读最新日报 · AI 入门推荐

2026-11-18 · America/Los_Angeles · 论文 · #18

VisualArtifactSpec 1.0: Evaluating Visual Artifacts under Task Specifications

Visual artifact tasks test agents' ability to translate task specifications and source materials into outputs that meet practical needs. Evaluation across artifact families helps distinguish broadly applicable authoring capabilities from strengths confined to a particular medium. We introduce VisualArtifactSpec 1.0 (VAS), a benchmark of 211 creation and modification tasks spanning presentations, static graphics, animations and videos, and web interfaces. Each task specifies authoring objectives, source materials, constraints, and deliverables. Existing benchmarks provide limited support for…

VisualArtifactSpec 1.0: Evaluating Visual Artifacts under Task Specifications

热度 36.9 / 100;排名与评分保留该期记录。