KV cache settings affect quality in Qwen3.8-27B-Q6_K, with Q8/Q8 outperforming Q4/Q4 and Q8/Q4, according to user observations
Read the original at old.reddit.com→What I found is when I use Q8/Q8 for KV cache, the model thinks a lot more than the Q4/Q4 or Q8/Q4. I also feel that the quality is a lot better when using Q8/Q8. submitted by /u/fbms2 [link] [comments]
Original headline: "KV cache may affect a lot on the quality in Qwen3.8-27B-Q6_K"
Coverage timeline
- Aug 19, 19:59 UTC r/LocalLLaMA lead source KV cache may affect a lot on the quality in Qwen3.8-27B-Q6_K