Partition-aware gated KV-cache eviction detects input classes where eviction harms accuracy versus where it is safe, reframing eviction as per-input admission decision.
Read the original at arxiv.org→arXiv:2609.22157v1 Announce Type: new Abstract: KV-cache eviction methods decide which tokens to keep but not whether to evict at all, so a benchmark mean can hide a class of inputs on which compression drives...
Original headline: "PAGE: Partition-Aware Gated KV-Cache Eviction"
Coverage timeline
- Sep 22, 04:00 UTC arXiv cs.LG lead source PAGE: Partition-Aware Gated KV-Cache Eviction
- Sep 22, 04:00 UTC arXiv cs.LG StepKV: Step-Aware KV Cache Compression for LLM Agents