2026-11-08 · America/Los_Angeles · 社区动态 · #19

Joined the 4x R9700 Club | Initial Benchmarks for QFN 3.8 Below

Posted this on the r/R9700 subreddit as well, but figured I'd share my initial findings here. tl;dr - One user writes at about 190 tok/s. Prefill runs at about 6,800 tok/s total no matter how many users there are. Agent follow-ups start in 0.2 to 2.5 s and write at 80 to 225 tok/s per user, even with 8 users at 128K context each. The worst case, 8 users each sending a fresh 128K prompt at the same moment, waits about 2.5 minutes for the first token. Yes yes I know the cards aren't all matching (the perfectionist in me is annoyed but they'll be in a case so who cares). PC Specs: CPU - EPYC…

热度 45.1 / 100；排名与评分保留该期记录。