2026-11-10 · America/Los_Angeles · 论文 · #10

SIRIS: Can LLMs Tell When Simulation Errors Matter in AI-Driven Systems Research

LLM agents increasingly drive systems research and rely on simulators to evaluate candidate designs at scale. Simulators are imperfect by design: their modeling limitations can distort predictions yet leave the recommended design correct, or change which design should be selected. We introduce Siris to test whether LLMs can tell these cases apart, judging from their systems understanding when a limitation invalidates the simulator's recommendation. By perturbing a simulator, Siris constructs workload pairs with the same candidates, limitation, and simulator recommendation. The perturbation…

热度 37.1 / 100；排名与评分保留该期记录。