C3: speech-guided KV retrieval for long-context SpeechLLM inference
Read the original at arxiv.org→arXiv:2611.00333v1 Announce Type: new Abstract: Speech language models encode audio at a much higher rate than text, causing the KV cache to dominate the memory, bandwidth, and decoding cost of long-form generation....
Original headline: "C3: Speech-Guided KV Retrieval for Long-Context SpeechLLM Inference"
Coverage timeline
- Nov 3, 05:00 UTC arXiv cs.LG lead source C3: Speech-Guided KV Retrieval for Long-Context SpeechLLM Inference