2026-11-10 · America/Los_Angeles · 论文 · #12

Infrathon: Benchmarking Language Agents for Real-World, Long-Horizon AI Infra Optimization

In this work, we study whether frontier agent can continually improve real-world AI infrastructure over long horizons. We introduce Infrathon, a benchmark of diverse, long-horizon AI infrastructure optimization tasks across different levels. We evaluate six models across 150 runs with 24-hour budgets, totaling over 10,000 GPU-hours. Our results show that model rankings vary with the evaluation horizon, while 135 of the 150 runs achieve further improvements during the second half of their budgets. These findings indicate that shorter evaluations can overlook both optimization gains and…

热度 42.9 / 100；排名与评分保留该期记录。