2026-10-27 · America/Los_Angeles · 论文 · #16

Eat Your Precision: Precision Objective Mitigates Reward Hacking in Rubric-based RL

Rubric-based rewards enable effective reinforcement learning on non-verifiable tasks. However, because these rewards are typically defined as a weighted measure of rubric coverage, models are trained primarily to maximize a recall objective. As a result, RL-trained models produce responses that are more complete but also more verbose and contain more unnecessary or factually incorrect content, leading them to be less preferred than responses from the base model. To address this issue, we present the FORK reward, which jointly optimizes recall and a novel precision objective, which requires…

热度 48.6 / 100；排名与评分保留该期记录。