ORL speeds diffusion language models: 2,788 tokens/s on a single RTX 5090 with LLaDA-2.1-mini + ORL and up to 6.9× end-to-end throughput improvements on QwenDLM-4B with ORL using dlmrt
Read the original at www.reddit.com→Hey r/LocalLLaMA! We're excited to share ORL (On-Policy Residual Learning), our new research on making diffusion language models (dLLMs) significantly faster without sacrificing generation quality. With ORL and our...
Original headline: "[Research] 2,788 tokens/s on a single RTX 5090 with a diffusion LLM — Introducing ORL (fully open source)"
Coverage timeline
- Oct 16, 19:33 UTC r/LocalLLaMA lead source [Research] 2,788 tokens/s on a single RTX 5090 with a diffusion LLM — Introducing ORL (fully open source)