2026-11-03 · America/Los_Angeles · 论文 · #17

IdeaTaste: Do LLMs Share the Research Taste of Human Researchers?

Research taste, the judgment of what to read, which problems to pursue, and which methods to try, increasingly shapes the work of AI scientists, yet it remains far less understood than their ability to execute research. We introduce IdeaTaste, a benchmark that scores an LLM by how closely the research proposals it writes from a literature snapshot frozen at 2025 match the work the same communities published in 2026. Our experiments span six contemporary language models and four research areas from established to emerging fields, covering more than 90{,}000 proposals in total. LLM agents fall…

热度 41.3 / 100；排名与评分保留该期记录。