2026-11-16 · America/Los_Angeles · 论文 · #6
Rethinking in Spikes: Mitigating Hallucinations in MDLMs with Step-Aware Decoding
Recent advancements in multimodal diffusion language models (MDLMs) have exhibited strong global modeling capabilities through iterative refinement. We observe that mask uncertainty follows an overall downward trend during iterative denoising, while a few denoising steps exhibit localized entropy spikes closely associated with hallucinations. We argue that anomalous steps can be identified by measuring the entropy deviation of each denoising step from its neighboring temporal window. We hypothesize that discrete token commitment discards the distributional information at masked positions,…
热度 48.7 / 100;排名与评分保留该期记录。