2026-11-11 · America/Los_Angeles · 论文 · #5

MACaQ: Fast, Model Agnostic Calibrated Quantization for Low-Precision Weights and Activations

Weight-activation quantization can reduce the memory and compute cost of neural-network inference, but recent methods often require expensive optimization and architecture-specific propagation of basis transforms across layers. We introduce MACaQ, an MXFP4 W4A4 post-training quantization method that treats every linear layer independently. MACaQ applies a per-channel scale and a block-Hadamard transform online to each layer's activations, while absorbing the corresponding inverse transforms into its weights. Retaining these transforms online avoids cross-layer dependencies and enables a…

热度 53.0 / 100；排名与评分保留该期记录。