X-CoSD: communication-efficient cross-vocabulary collaborative speculative decoding
Read the original at arxiv.org→arXiv:2609.09166v1 Announce Type: new Abstract: This paper investigates collaborative speculative decoding (CoSD), a distributed large language model (LLM) inference framework in which an on-device small language...
Original headline: "X-CoSD: Communication-Efficient Cross-Vocabulary Collaborative Speculative Decoding"
Coverage timeline
- Sep 10, 04:00 UTC arXiv cs.CL lead source X-CoSD: Communication-Efficient Cross-Vocabulary Collaborative Speculative Decoding