Inconsistencies observed in Unsloth LiveCodeBench results; all four Unsloth quantizations and Q8 baseline show 2–3 percentage-point gains on LiveCodeBench v6, with GSQ-RCO results less consistent.
Read the original at www.reddit.com→I compared two published benchmark charts for DeepSeek-V4.1-Flash-1017 and noticed something rather unusual. All four Unsloth quantizations AND the Q8 baseline simultaneously improved by approximately 2–3 percentage...
Original headline: "Inconsistencies in Unsloth's LiveCodeBench Results"
Coverage timeline
- Nov 2, 21:05 UTC r/LocalLLaMA lead source Inconsistencies in Unsloth's LiveCodeBench Results