AI Resonance · 阅读最新日报 · AI 入门推荐

2026-11-17 · America/Los_Angeles · 论文 · #7

K2-Horizon: A Frontier Fleet of Open Source Language Models

We present K2-Horizon, a fleet of six fully open language models, from a 0.9B dense model to a 375B-A23B MoE, built for general-purpose reasoning and agentic work across math and science, software engineering, deep research, office automation, and beyond. The models lead or are competitive with strong open models of their size on agentic and coding benchmarks. On the modeling side, to strengthen reasoning, we introduce Mixture-of-Value Attention (MoVA), applying MoE to attention value projections, and softplus attention gating, a more flexible, theoretically motivated gate. Our 36B-A4B model…

K2-Horizon: A Frontier Fleet of Open Source Language Models

热度 50.6 / 100;排名与评分保留该期记录。