Dwarfstar quants offer clever model-specific quant techniques; user reports fast Qwen 3.8 next on M3 Ultra with memory headroom, seeking others’ experiences
Read the original at www.reddit.com→anyone try these out? https://dwarfstar.sh they have very clever quant techniques, bespoke for a handful of models running on their software. i got qwen 3.8 next running on m3 ultra 96GB studio and its fast and seems...
Original headline: "Dwarfstar quants"
Coverage timeline
- Oct 1, 15:12 UTC r/LocalLLaMA lead source Dwarfstar quants