2026-10-26 · America/Los_Angeles · 论文 · #12

On-Policy Self-Training: Data-Free Self-Improvement in Large Language Models

On-policy self-distillation enables post-training foundation models without relying on stronger external teachers. However, existing approaches rely on ground-truth question-answer pairs, human-curated problem sets, or other supervised signals. In this work, we reformulate on-policy self-distillation as a self-training framework, driven by self-generated question-answer pairs and privileged reasoning demonstrations. We push supervision to the limit: guided solely by coarse, high-level topic descriptions, the model synthesizes its own curriculum of queries and privileged reasoning traces…

热度 44.5 / 100；排名与评分保留该期记录。