Entropy-Constrained Adaptive Stochastic Quantization proposed to optimize MSE while preserving unbiasedness for compression of models, gradients, KV-cache, and nearest-neighbor search workloads
Read the original at arxiv.org→arXiv:2608.18147v1 Announce Type: new Abstract: Adaptive stochastic quantization (ASQ) is a recently introduced quantization approach that optimizes the Mean Squared Error (MSE) for a given input while preserving...
Original headline: "Entropy-Constrained Adaptive Stochastic Quantization"
Coverage timeline
- Aug 20, 04:00 UTC arXiv cs.LG lead source Entropy-Constrained Adaptive Stochastic Quantization