FAD-KV: Adaptive Dictionary KV Caching for Efficient Reasoning Decoding
Read the original at arxiv.org→arXiv:2610.37921v1 Announce Type: new Abstract: Key-value (KV) caching is a core mechanism in large language models, where intermediate key and value representations are stored to accelerate autoregressive decoding....
Coverage timeline
- Oct 30, 04:00 UTC arXiv cs.CL lead source FAD-KV: Adaptive Dictionary KV Caching for Efficient Reasoning Decoding