AI Resonance · 阅读最新日报 · AI 入门推荐

2026-11-18 · America/Los_Angeles · 论文 · #3

Weight-Space Programming Doesn't Need Transformers

Standard neural architectures such as the Transformer were chosen because they train well with gradient descent and run fast on GPUs. In weight-space programming, a large language model (LLM) writes target weights by hand without gradient-based training, so those reasons no longer apply. Should we keep the Transformer? Given minimal guidance, ten labeled examples, and a sandbox, mainly on multiple-choice questions, we task three frontier LLMs with either generating the weights of a fixed architecture or designing the architecture themselves. When free to design, all three compile plain-text…

Weight-Space Programming Doesn't Need Transformers

热度 54.1 / 100;排名与评分保留该期记录。