How to compare quants from various sources?
Read the original at old.reddit.com→How do you guys deal with so many variables? So many publishers, each calling their quants "best", and then it's a mess to manage, download the weights, tweak the temperature etc. for each source? It is relatively...
Original headline: "How to even compare quants from various sources?"
Coverage timeline
- Aug 7, 19:10 UTC r/LocalLLaMA lead source How to even compare quants from various sources?