2026-10-19 · America/Los_Angeles · 论文 · #5
Into the Unknown: Benchmarking AI agents on open scientific research problems
Can AI agents carry out research on open scientific problems? We introduce Into the Unknown, a benchmark that provides an agent with a science paper along with a research direction to pursue and tasks it to write a follow-up paper. We work with scientists at US Department of Energy (DOE) national laboratories, who each contribute an unpublished follow-up direction from their own work together with the necessary conditions a submission must meet. While assessing the quality of a follow-up paper is challenging in general, using these conditions to form a rubric makes evaluation more tractable…
热度 60.9 / 100;排名与评分保留该期记录。