MoE experts loaded from disk in llama.cpp's WebGPU backend in a Chrome tab for an 80B Qwen3-Next model (48 GB GGUF)
Read the original at www.reddit.com→Follow-up to last week's post about streaming MoE experts from disk in a browser tab. That ran on hand-written engines for two models. This week the same disk tier sits under llama.cpp's own WebGPU backend, so it...
Original headline: "An 80B MoE (Qwen3-Next, 48 GB GGUF) answering in a Chrome tab: llama.cpp's WebGPU backend, experts paged in from disk"
Coverage timeline
- Oct 13, 14:04 UTC r/LocalLLaMA lead source An 80B MoE (Qwen3-Next, 48 GB GGUF) answering in a Chrome tab: llama.cpp's WebGPU backend, experts paged in from disk