AI Resonance · 阅读最新日报 · AI 入门推荐

2026-11-18 · America/Los_Angeles · 论文 · #17

DNeo: Your Parallel Draft Model Needs Better Target Feature Encoding

Speculative-diffusion decoding uses a small parallel drafter model to generate b draft tokens in one forward pass, which then undergo parallel verification via a larger target model. Faster inference can be achieved when multiple draft tokens pass verification simultaneously. Recent parallel draft architectures (DFlash, DSpark) improve draft quality by conditioning on rich features computed by the target, through a mechanism known as feature encoding. However, standard feature encoding mechanisms have three limitations: (1) they are lossy, applying encoding projections that are destructive…

DNeo: Your Parallel Draft Model Needs Better Target Feature Encoding

热度 40.0 / 100;排名与评分保留该期记录。