Qwen4 35B A3B or similar awaited; Gemma 26B QAT praised for solid 26 Tg/s performance
Read the original at www.reddit.com→One can only hope for Qwen4 35B A3B or similar (maybe with extra ngrams for 35B -> 70B+... until then, Gemma 26B QAT my beloved (solid 26 Tg/s)... submitted by /u/RobustLokiX [link] [comments]
Original headline: "POV 8GB VRAM + 16GB RAM folks checking locallama everyday:"
Coverage timeline
- Oct 3, 14:16 UTC r/LocalLLaMA lead source POV 8GB VRAM + 16GB RAM folks checking locallama everyday: