2026-11-13 · America/Los_Angeles · 论文 · #1
SO-Arena: Benchmarking the Capability Spectrum and Reliability of System One Models
System One models promise fast, general-purpose decision-making without lengthy token generation. However, understanding their capability spectrum and decision reliability requires more than aggregate performance on current benchmarks. Existing evaluations often provide limited insight into the breadth of model capabilities and the reliability of their decisions. We introduce SO-Arena, a benchmark characterizing the capability spectrum and decision reliability of System One models across 11 domains and five capability families. For the capability spectrum, SO-Arena offers evidence-grounded…
热度 61.0 / 100;排名与评分保留该期记录。