RoLaQ: joint rotation and range calibration for 2-bit KV caches in multi-head latent attention
Read the original at arxiv.org→arXiv:2610.20686v1 Announce Type: new Abstract: Multi-head latent attention (MLA) compresses the content of a key-value cache into a shared latent per token, making low-bit storage attractive for long-context...
Original headline: "RoLaQ: Joint Rotation and Range Calibration for 2-Bit KV Caches in Multi-Head Latent Attention"
Coverage timeline
- Oct 16, 04:00 UTC arXiv cs.LG lead source RoLaQ: Joint Rotation and Range Calibration for 2-Bit KV Caches in Multi-Head Latent Attention