2026-10-31 · America/Los_Angeles · 社区动态 · #7

Betelgeuse running Qwen 3.8 Flash Next IQ4_XS at 24 tok/s on 2x8GB DDR4 (14 tok/s on a single 16GB stick) + RTX 3060 12GB — 0 dropped experts, 100% byte-exact

In my last thread on Betelgeuse (bel-cli / bel-server), the main pushback in the comments was: "Okay cool, 22 tok/s on IQ2_XS, but 2-bit is too low—what happens on an actual 4-bit quant like IQ4_XS where the experts are almost 2x larger?" "Why were you testing on a single 16GB stick of DDR4 instead of normal dual-channel 2x 8GB?" Fair questions. So I upgraded the oracle + victim-cache DMA path, packed IQ4_XS (~100GB+ class, full 4-bit experts), and tested it on the exact same RTX 3060 12GB under both RAM configs (still 16GB total system RAM in both tests): Config A: 1x 16GB DDR4…

热度 49.4 / 100；排名与评分保留该期记录。