AI Resonance · 阅读最新日报 · AI 入门推荐

2026-11-16 · America/Los_Angeles · 论文 · #6

Rethinking in Spikes: Mitigating Hallucinations in MDLMs with Step-Aware Decoding

Recent advancements in multimodal diffusion language models (MDLMs) have exhibited strong global modeling capabilities through iterative refinement. We observe that mask uncertainty follows an overall downward trend during iterative denoising, while a few denoising steps exhibit localized entropy spikes closely associated with hallucinations. We argue that anomalous steps can be identified by measuring the entropy deviation of each denoising step from its neighboring temporal window. We hypothesize that discrete token commitment discards the distributional information at masked positions,…

Rethinking in Spikes: Mitigating Hallucinations in MDLMs with Step-Aware Decoding

热度 48.7 / 100;排名与评分保留该期记录。