2026-11-02 · America/Los_Angeles · 社区动态 · #3
Sparks of Weight-Space Programming: LLMs can natively read & write neural network weights [R]
Link: https://rikiyat.github.io/blog/weight-space-programming/ Snippet: “We find that frontier LLMs are surprisingly good at natively reading and writing neural network weights, well past what we’d expect from humans or conventional algorithms. This might be a big deal for both optimization and interpretability. Just by looking at the raw weights, GPT-6 Astra can tell what a network was trained to do . And without any environment feedback, it has no trouble writing, from scratch, small game-playing networks that outplay networks trained with PPO for 100 million steps.” Very surprising…
热度 51.7 / 100;排名与评分保留该期记录。