AttSVD: prompt-adaptive low-rank KV cache compression via attention-guided SVD
Read the original at arxiv.org→arXiv:2610.06927v1 Announce Type: new Abstract: The key-value (KV) cache of autoregressive transformers grows linearly with context length and dominates memory at long context. Most training-free remedies evict...
Original headline: "AttSVD:Prompt-Adaptive Low-Rank KV Cache Compression via Attention-Guided SVD"
Coverage timeline
- Oct 7, 04:00 UTC arXiv cs.LG lead source AttSVD:Prompt-Adaptive Low-Rank KV Cache Compression via Attention-Guided SVD
- Oct 7, 04:00 UTC arXiv cs.LG Mask-Guided KV Cache Eviction in Block Diffusion Language Models