2026-10-08 · America/Los_Angeles · 论文 · #16

ReSAIL: Mitigating Collapse in Iterative Agent Self-Distillation

Iterative self-distillation enables LLM agents to learn from successive deployments, offering a path toward recursive self-improvement (RSI). Yet our experiments with existing methods reveal a collapse in deployment performance across cycles, while task performance with privileged information (PI) also declines. We address this collapse by prioritizing informative interaction steps for distillation and preserving PI-conditioned behavior as the student becomes the next teacher. We introduce Retentive and Selective Augmentation for Iterative Self-Distillation (ReSAIL), a plug-in augmentation…

热度 51.1 / 100；排名与评分保留该期记录。