Ported TurboFieldfare to Qwen 3.6 35B; runs in about 1.4 GB RAM
Read the original at old.reddit.com→Was playing around with TurboFieldfare, a Mac engine that runs Gemma 4 26B in ~2 GB by streaming MoE experts off SSD instead of loading them. It only supported that one model, so I added support for Qwen 3.6 35B-A3B....
Original headline: "I ported TurboFieldfare to Qwen 3.6 35B and it runs in 1.4 GB of RAM"
Coverage timeline
- Jul 31, 12:14 UTC r/LocalLLaMA lead source I ported TurboFieldfare to Qwen 3.6 35B and it runs in 1.4 GB of RAM