2026-11-01 · America/Los_Angeles · 论文 · #1

Optimizing Stochastic Policy Geometry for Few-Step Flow Reinforcement Learning

Few-step flow models generate samples through a handful of large denoising transitions. Applying GRPO to such models requires introducing stochasticity into the denoising transitions, and when a single transition spans a wide range of noise levels, the choice of the resulting stochastic policy becomes a major factor in optimization. Recent constructions constrain the policy to preserve the target flow coefficients, but this constraint admits a family of policies and offers no criterion for choosing among them. We introduce Geo-FSRL (Geometry-Optimized Few-Step Reinforcement Learning), built…

热度 27.6 / 100；排名与评分保留该期记录。