2026-10-25 · America/Los_Angeles · 论文 · #16
SOPO: Socratic Guided Policy Optimization for Span-Level Hallucination Detection
Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, but suffer from hallucination issues where they generate unfaithful or inconsistent content. While Reinforcement Learning with Verifiable Rewards (RLVR) has shown promising applications in reasoning tasks, its application to span-level hallucination detection is challenged by localization ambiguity, reward sparsity on hard examples, and uncontrolled length inflation. To address these issues, we introduce Socratic Guided Policy Optimization (SOPO), a multi-turn RL framework for robust…
热度 14.0 / 100;排名与评分保留该期记录。