HeadGuard protects a subset of KV heads in low-bit VLM KV-cache quantization to preserve accuracy
Read the original at arxiv.org→arXiv:2609.35800v1 Announce Type: new Abstract: Low-bit key-value (KV) cache quantization saves storage but can sharply degrade vision-language model (VLM) accuracy. We introduce HeadGuard, a composable...
Original headline: "HeadGuard: Selective Head Protection for Low-Bit VLM KV-Cache Quantization"
Coverage timeline
- Sep 30, 04:00 UTC arXiv cs.LG lead source HeadGuard: Selective Head Protection for Low-Bit VLM KV-Cache Quantization