2026-10-29 · America/Los_Angeles · 社区动态 · #3

10 coding agents, one Qwen 3.8 27B, same llama-server: tokens and cache reuse differ more than pass rates

Part 2 of my agent test (part 1 was a 4B model) Hardware I used: MacBook Pro M5 Max, 64 GB. Qwen 3.8 27B Q4 on llama.cpp, thinking off. Setup same model and server for everyone 5 small coding tasks, each with a little trap each agent locked in a sandbox: it can only touch its own folder and only talk to the model auto-approve on, telemetry off, 5 min limit Results # Agent Passed Median time Median tokens Cache reuse Tried to go online 1 Pi 5/5 38 s 9.2k 72% no 2 DeepSeek Harness 5/5 60 s 35.3k 83% no 3 Codex CLI 5/5 94 s 36.3k 79% every run 4 OpenClaw 5/5 106 s 39.0k 72% unclear 5 Cline 5/5…

热度 49.8 / 100；排名与评分保留该期记录。