366 t/s Qwen3.6 27B NVFP4 on v100s
Read the original at old.reddit.com→These are single stream numbers Following on from my previous post about v100s (here) and inspired by this comment (here) I decided to work on kernels that allow for an extremely fast path for Nvfp4 weights on sm70...
Coverage timeline
- Aug 11, 20:28 UTC r/LocalLLaMA lead source 366 t/s Qwen3.6 27B NVFP4 on v100s