arXiv paper identifies structural-role bias in LLM KV cache eviction; non-stationary filtering retains noise in schema-dense inputs
Read the original at arxiv.org→arXiv:2607.13205v1 Announce Type: new Abstract: Attention-based KV cache eviction (H2O and its descendants) compresses the memory-constrained state of a long-context model by ranking tokens on accumulated attention...
Original headline: "Adaptive Filtering of the KV Cache: Diagnosing and Correcting Structural-Role Bias in LLM Inference"