2026-11-10 · America/Los_Angeles · 论文 · #12

FewStepRL: Fine-tuning Few-step Diffusion Models with Reinforcement Learning

Reinforcement learning (RL) has become a standard post-training method for diffusion models, but most RL objectives roll out the current policy at every iteration, and with a many-step sampler these rollouts typically dominate the cost of training. Few-step models cut this cost, yet they model an average velocity over an interval, whereas existing RL objectives are built for an instantaneous velocity with a many-step sampler. We adapt RL objectives to few-step models systematically in three phases, namely a transformation, a decomposition and an adaptation. The transformation to x-space…

热度 34.4 / 100；排名与评分保留该期记录。