Quantization of large models with weight outliers and sparsity
Read the original at arxiv.org→arXiv:2611.00286v1 Announce Type: new Abstract: Post-training quantization (PTQ) reduces the memory burden of large model deployment by casting the high precision trained weights to fewer bits. While this promotes...
Original headline: "Quantization of Large Models with Weight Outliers and Sparsity"
Coverage timeline
- Nov 3, 05:00 UTC arXiv cs.LG lead source Quantization of Large Models with Weight Outliers and Sparsity