Osprey: Target-agnostic pre-training makes stronger drafters in speculative decoding
Read the original at arxiv.org→arXiv:2609.09338v1 Announce Type: new Abstract: Speculative decoding is critical for accelerating LLM inference. However, the speedup is fragile: drafters are typically trained against a narrow distribution for a...
Original headline: "Osprey: Target-agnostic Pre-training Makes Stronger Drafters in Speculative Decoding"
Coverage timeline
- Sep 10, 04:00 UTC arXiv cs.CL lead source Osprey: Target-agnostic Pre-training Makes Stronger Drafters in Speculative Decoding