Qwen 3.8 27b setup for 16 GB VRAM: seeking 128k context and speed with llamacpp on 5060Ti system
Read the original at www.reddit.com→Hello guys! I have been experimenting with qwen 3.8 for a long time and I hadn't been able to get reasonable speed. I am on a 5060Ti 16 GB, and although this gpu can game, I am aware that AI demands more than 16 GB....
Original headline: "What's the best setup for Qwen3.8 27b for a 16 gig VRAM?"
Coverage timeline
- Oct 1, 17:57 UTC r/LocalLLaMA lead source What's the best setup for Qwen3.8 27b for a 16 gig VRAM?