PeekKV: the first content token already knows which heads matter
Read the original at arxiv.org→arXiv:2610.23939v1 Announce Type: new Abstract: The size of the KV cache grows linearly with context length, making it a major memory bottleneck in LLM serving. Motivated by recent progress in identifying the...
Original headline: "PeekKV: The First Content Token Already Knows Which Heads Matter"
Coverage timeline
- Oct 20, 04:00 UTC arXiv cs.LG lead source PeekKV: The First Content Token Already Knows Which Heads Matter