2026-11-09 · America/Los_Angeles · 论文 · #17

Steerable Multi-Objective Group-Relative Preference Optimization with Jointly Trained Low-Rank Adapters

Language model deployment often requires different trade-offs between competing objectives as user preferences change, yet standard post-training methods typically produce a single policy for a fixed objective weighting. We introduce LambdaMix, a new parameter efficient method for learning a preference conditioned family of policies with group-relative online reinforcement learning. LambdaMix jointly trains one low-rank adapter per objective over a frozen base model. One preference vector selects the adapter mixture that generates responses and weights the separately normalized rewards used…

热度 33.2 / 100；排名与评分保留该期记录。