SGLang runs Qwen+Dflash and Laguna on V100 with TeilLang FlashAttention, marlin-v100, and Dflash support for Qwen 3.5/3.6; Laguna S2.1 support added, but Dflash for Laguna not yet working.
Read the original at old.reddit.com→Forked SGLang, wrote TeilLang FlashAttention for V100, used open-source marlin-v100, ungated flashinfer for sm70, made Dflash work for Qwen3.5/3.6 models, added Laguna S2.1 support, tried to make dflash work for...
Original headline: "For V100 Users: SGLang running Qwen+Dflash and Laguna"
Coverage timeline
- Jul 27, 10:20 UTC r/LocalLLaMA lead source For V100 Users: SGLang running Qwen+Dflash and Laguna