2026-11-12 · America/Los_Angeles · 论文 · #2

SteerDistill: Quantizing LLM Agents via Closed-Loop Teacher Steering

Low-bit quantization reduces the inference cost of LLM agents but can compromise task success. Examining failed rollouts, we find that quantized agents overlook task requirements or environmental conditions, producing environment transitions that diverge from successful full-precision references. Correcting these behavioral divergences remains difficult: offline data may miss the student's failure contexts, while its own rollouts may provide few correct responses in those contexts. We introduce SteerDistill, a quantization-aware distillation method in which a full-precision teacher guides…

热度 45.2 / 100；排名与评分保留该期记录。