Partition-aware gated KV-cache eviction detects input classes where eviction harms accuracy versus where it is safe, reframing eviction as per-input admission decision.
Read the original at arxiv.org→arXiv:2609.22157v2 Announce Type: new Abstract: KV-cache eviction can do more than compress. In long-context LLMs, keeping only some cached tokens sometimes matches or exceeds full-cache accuracy, because many...
Original headline: "PAGE: Partition-Aware Gated KV-Cache Eviction"
Coverage timeline
- Sep 22, 04:00 UTC arXiv cs.LG lead source PAGE: Partition-Aware Gated KV-Cache Eviction
- Sep 22, 04:00 UTC arXiv cs.LG StepKV: Step-Aware KV Cache Compression for LLM Agents