2026-11-04 · America/Los_Angeles · 论文 · #20

Every Token Needs Its Own Teacher: Multi-teacher Adaptive On-policy Self-distillation

On-policy Self-distillation (OPSD) has proven effective for post-training large language models by constructing a teacher conditioned on privileged references. However, existing approaches keep the teacher fixed either throughout training by consistently exposing it to the full reference, or within each response by adaptively varying partial reference exposure only across responses. In this paper, we argue that neither of them is sufficient. Instead, every token needs its own teacher, as the teacher preference can vary token by token within the same response. Through a teacher-intervention…

热度 40.4 / 100；排名与评分保留该期记录。