Gemma 4 26B/31B Q4 QAT vs Q4/Q5/Q6/Q8
Read the original at old.reddit.com→What are your experiences with Gemma 4's QAT versions compared to their regular ones? So far I have mostly heard about regressions, but if you have a different experience or even benchmarks that are in favor of QAT,...
Coverage timeline
- Jul 28, 21:00 UTC r/LocalLLaMA lead source Gemma 4 26B/31B Q4 QAT vs Q4/Q5/Q6/Q8