Multi-draft on-policy distillation for diffusion drafters

arXiv:2610.37778v1 Announce Type: new Abstract: Speculative decoding is used to reduce the inference cost of language models. One-step diffusion drafters propose a block of multiple tokens in parallel, reducing the...