2026-09-19 · America/Los_Angeles · 社区动态 · #7

Please stop with the FP4 inference engines for the love of god

Every day there's a new post of some optimized config or new inference engine that is just super good at one specific thing and their claims make sense. And then at the bottom of the post or maybe after someone asked it says "NVFP4/MXFP4 only". Okay dude, good job! You made the fastest possible option a little slightly faster, and most likely your output is completely cooked and you get hallucinations left right and center. Just saw another one in r/ROCm again. It's fine if you run 4-bit for large models, they've got lots of shit in them so a little bit of loss just means they won't remember…

热度 45.9 / 100；排名与评分保留该期记录。