Qwen 3.8 27B performance on a 16 GB VRAM GPU; user seeks large-context setup and faster speed
Read the original at www.reddit.com→Hello guys! I have been experimenting with qwen 3.8 for a long time and I hadn't been able to get reasonable speed. I am on a 5060Ti 16 GB, and although this gpu can game, I am aware that AI demands more than 16 GB....
Original headline: "What's the best setup for Qwen3.8 27b for a 16 gig VRAM?"
Coverage timeline
- Oct 1, 17:57 UTC r/LocalLLaMA lead source What's the best setup for Qwen3.8 27b for a 16 gig VRAM?
- Oct 1, 20:04 UTC r/LocalLLaMA Qwen3.8-27B Q4_K_M on one RTX 3090 + OpenCode: throughput, four coding tasks, and a reasoning-budget failure
- Oct 2, 11:19 UTC r/LocalLLaMA Qwen3.8-Flash-Next (5.05bpw + ngram at bf16) exl3 on one r9700: 863 t/s prefill and 35 t/s decode at 230k context (256k max), is that ok or am i missing something?
- Oct 2, 14:02 UTC r/LocalLLaMA Help me with a better hardware setup for Local LLm
- Oct 3, 01:33 UTC r/LocalLLaMA The fastest interference engine for RTX5090 and Qwen3.8 27B. Twice as fast as ninfer. 500+ t/s single coding, 2000+t/s up to 12 agents at the same time with 800k context. Smart VRAM-RAM-DISC Cache management, Loop Guard, Nice UI etc.
- Oct 3, 06:49 UTC r/LocalLLaMA Qwen3.8-Flash-Next 177B running at 11–15 tok/s on a single RTX 5070 12GB + 32GB RAM DDR4
- Oct 3, 11:11 UTC r/LocalLLaMA Thanks to Strata I have quit 27b for Qwen Flash (24gb VRAM plus 64gb ram)
- Oct 3, 20:06 UTC r/LocalLLaMA Running Qwen3.8 Flash Next 176B on a 16GB RTX 3080 Laptop + 32GB RAM + SSD
- Oct 3, 23:44 UTC r/LocalLLaMA Strata Qwen 3.8 flash next is the biggest thing since the release of Qwen 3.8 27b
- Oct 4, 04:54 UTC r/LocalLLaMA The curse of 64GB system RAM