SPECTRA: pushing the KV cache beyond the 2-bit cliff via spectral transform coding
Read the original at arxiv.org→arXiv:2608.07915v1 Announce Type: new Abstract: Large language models (LLMs) increasingly read long inputs in the agentic era, from whole documents and codebases to conversations across many turns. Their inference...
Original headline: "SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding"
Coverage timeline
- Aug 11, 04:00 UTC arXiv cs.LG lead source SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding