CUDA: fuse MoE gate/up matmuls and GLU in MMQ for llama.cpp
Read the original at www.reddit.com→download your CUDA/MoE prompt-processing speedup today: GPU model master PR DGX Spark (GB10) Qwen3-30B-A3B Q4_K_M 2911.4 3410.8 +17.2% Qwen3.6-35B-A3B Q4_K_M 3235.8 3556.7 +9.9% Qwen3.6-35B-A3B UD-Q4_K_M...
Original headline: "CUDA: fuse MoE gate/up matmuls and GLU in MMQ by anujj · Pull Request #31188 · ggml-org/llama.cpp"
Coverage timeline
- Oct 28, 13:40 UTC r/LocalLLaMA lead source CUDA: fuse MoE gate/up matmuls and GLU in MMQ by anujj · Pull Request #31188 · ggml-org/llama.cpp