AI Resonance · 阅读最新日报 · AI 入门推荐

2026-11-13 · America/Los_Angeles · 论文 · #15

UniSpark: Exploring Hybrid Attention for Multimodal Understanding and Generation

We present UniSpark-9B, a unified multimodal model that investigates hybrid attention for visual understanding and generation. Built on a Mixture-of-Transformer-Experts backbone with approximately 9B parameters in each branch, UniSpark combines full attention for explicit token interactions with GatedDeltaNet linear attention for compact context propagation. Autoregressive text prediction and visual flow matching jointly support visual question answering, text-to-image generation, instruction-guided editing, and interleaved text-image prediction. In interleaved generation, noisy visual…

UniSpark: Exploring Hybrid Attention for Multimodal Understanding and Generation

热度 37.7 / 100;排名与评分保留该期记录。