Diversity-aware, layer-wise scoring for KV cache eviction improves ranking beyond mean attention by incorporating dispersion and redundancy penalties
Read the original at arxiv.org→arXiv:2609.30738v1 Announce Type: new Abstract: KV cache eviction methods such as SnapKV and PyramidKV rank tokens solely by mean attention over a small observation window. We study a unified score,...
Original headline: "Beyond Mean Attention: Diversity-Aware, Layer-Wise Scoring for KV Cache Eviction"
Coverage timeline
- Sep 28, 04:00 UTC arXiv cs.CL lead source Beyond Mean Attention: Diversity-Aware, Layer-Wise Scoring for KV Cache Eviction