2026-10-30 · America/Los_Angeles · 论文 · #11

Co-Design Bench: Multimodal Collaborative Coding Evaluation for Agentic Models

Evaluating human-AI co-design requires testing whether coding agents can translate real users' multimodal requests into working application revisions. We introduce Co-Design Bench, a reference-free benchmark of 273 tasks curated from 37,463 deduplicated queries across 26,314 real user coding sessions. Its two tracks, Multimodal Editing (ME) and Repository Editing (RE), cover localized edits with optional image, audio, video, or document inputs and coordinated repository revisions. Tasks span three capability dimensions: Grounded Understanding, UI Transformation, and Functional…

热度 49.1 / 100；排名与评分保留该期记录。