PRQuant: permutation residual quantization for low-overhead inference
Read the original at arxiv.org→arXiv:2609.22106v1 Announce Type: new Abstract: Accuracy of Low-bit quantization of linear layers is often dominated by a small number of outliers. Although existing methods, such as smoothing, rotation, or...
Original headline: "PRQuant: Permutation Residual Quantization for Low-Overhead Inference"
Coverage timeline
- Sep 22, 04:00 UTC arXiv cs.LG lead source PRQuant: Permutation Residual Quantization for Low-Overhead Inference