2026-11-09 · America/Los_Angeles · 论文 · #11

AutoCompress: Automated Hardware-Guided Model Compression

LLM pruning must preserve quality while meeting hardware- and workload-specific constraints on latency, throughput, and memory. Existing pruning workflows often target parameter counts, requiring practitioners to manually select model sizes that meet latency, throughput, and GPU memory limits. However, parameter count alone does not predict these metrics, which depend on the model architecture, workload, hardware, and serving engine. We introduce AutoCompress, a hardware-guided compression framework that directly incorporates such constraints into differentiable architecture search.…

热度 35.9 / 100；排名与评分保留该期记录。