2026-10-19 · America/Los_Angeles · 论文 · #6

PremiseCheck: Efficient Fact-Checking of Human and AI Peer Reviews

Peer review is under strain from the growth of submissions, and review comments written by humans or AI can misstate what a paper says. We introduce ReviewFact, a benchmark that labels such factual errors in review comments under one definition across NLP, machine learning, and the natural sciences, and that measures cost and latency alongside accuracy. A frontier LLM checks comments well but must read the whole paper for each check, while cheap decision models, which score whether a statement holds in a text, fall far short on whole comments that mix several implicit assertions.…

热度 59.1 / 100；排名与评分保留该期记录。