More enthusiasts will use custom quantisations built by opus and Asta for their hardware and precision needs
Read the original at www.reddit.com→Based on my own little experiment and other reports I predict that more and more enthusiasts will ask a frontier LLM to build a custom quant of their favourite model. If Qwen 4 finally arrives I’ll try a ready made...
Original headline: "Prediction: more enthusiasts will get custom quantisations build by opus and Asta for their hardware and precision needs"
Coverage timeline
- Nov 10, 06:47 UTC r/LocalLLaMA lead source Prediction: more enthusiasts will get custom quantisations build by opus and Asta for their hardware and precision needs