AI Resonance · 阅读最新日报 · AI 入门推荐

2026-11-15 · America/Los_Angeles · 论文 · #8

V-JEPA-LM: Video-Language Models That Read Dynamics Beyond Static, Text-Aligned Representations

World-model video encoders such as V-JEPA learn how scenes change (direction, speed, order, state) from video alone. To answer questions, they are joined to a language model trained on captions and question-answer pairs. But each caption or question names only a few attributes of a clip, so the model learns to retrieve those attributes rather than to read the clip, and the dynamics the encoder carries go unused: on the same items, a linear probe reads speed from frozen V-JEPA features at 87% while the VLM answers at chance. We show where dynamics lives in a frozen encoder: in a subspace…

V-JEPA-LM: Video-Language Models That Read Dynamics Beyond Static, Text-Aligned Representations

热度 14.0 / 100;排名与评分保留该期记录。