2026-11-17 · America/Los_Angeles · 论文 · #13
Accelerate Bench: Evaluating Agents for Application-Level Program Optimization
Application optimization requires coding agents to discover useful changes and coordinate them across a complete program while preserving the required computation. We introduce Accelerate Bench, a benchmark of 32 CPU optimization tasks adapted from scientific applications and supercomputing competitions. Each task provides a working program and specifies the workload, correctness requirements, timing boundaries, and permitted edits, leaving agents to choose where and how to optimize. Public testing supports iterative development, and a separate verifier scores the final submission. On…
热度 43.6 / 100;排名与评分保留该期记录。