2026-09-28 · America/Los_Angeles · 社区动态 · #8

Finally found a model my hardware can run at full precision: me

Was getting bored trying to squeeze every last t/s out of my local model on my hardware, so I made a tps counter for my fingers instead (with real tokenizers, of course). My best is around 2 t/s. According to the page, that beats a 70B on a laptop CPU and is roughly 76x slower than an 8B on a 4090. So yeah. If you want something to do while waiting for your LLM to answer, give it a try! https://homoagens.github.io/human-tps/ PS: you can also share your result.. who knows, maybe I'll get famous:)

热度 47.8 / 100；排名与评分保留该期记录。