2026-11-11 · America/Los_Angeles · 论文 · #15

ExRL: Sample-Efficient Online Adaptation of Long-Chunk Policies via Execution Length Control

Predicting long action chunks, often spanning dozens of timesteps, has become a key ingredient in increasingly capable robot policies. In this paper, we find that adapting these long-chunk policies with existing reinforcement learning (RL) methods can require many online samples due to the high dimensionality of the action chunks being optimized, making such adaptation impractical in real-world scenarios where interaction data are costly to collect. Our key insight is to shift adaptation from optimizing actions to optimizing how long to execute each predicted action chunk. This keeps the…

热度 33.6 / 100；排名与评分保留该期记录。