2026-09-29 · America/Los_Angeles · 社区动态 · #7

I wrote a free, open-source book on making ML models actually fast, from silicon to agents [P]

I’ve spent the last few months writing something I wish I had when I started working on ML performance engineering. It’s called How to Make Your Model Fast: A Systems View of Efficient Machine Learning, from Silicon to Agents . The basic idea is that reducing FLOPs doesn’t necessarily make a model faster. Before optimising anything, you need to understand what the system is actually bounded by. The book starts with roofline analysis and hardware, then works its way up through kernels, compilers, quantisation, pruning, vision, on-device LLMs, robotics, profiling, serving and finally agents.…

热度 49.0 / 100；排名与评分保留该期记录。