PolyGraph: Plan-buffer CUDA Graphs for Adaptive Speculative Decoding
Read the original at arxiv.org→arXiv:2610.23861v1 Announce Type: new Abstract: Adaptive speculative decoding changes the active batch size B and draft length d from one decode step to the next, whereas a CUDA Graph replays a fixed launch...
Original headline: "PolyGraph: Plan-Buffered CUDA Graphs for Adaptive Speculative Decoding"
Coverage timeline
- Oct 20, 04:00 UTC arXiv cs.LG lead source PolyGraph: Plan-Buffered CUDA Graphs for Adaptive Speculative Decoding