Flint benchmark shows poor results for unsloth/flint-GGUF on 3 harnesses; AtomicAgent and OMP underperform, Hermes halts before Task 7, Deepseek not run
Read the original at www.reddit.com→Unsloth Flint Q3 Results Performed quite poorly on benchmark using 3 diff harnesses: OMP: Completed all 12 tasks; 71.2/100 (only 7 solved). AtomicAgent: Completed all 12 tasks; 39.2/100 (only 3 solved). Hermes:...
Original headline: "RecursiveSI Flint Benchmark: unsloth/flint-GGUF flint-UD-Q3_K_XL.gguf"
Coverage timeline
- Oct 24, 19:32 UTC r/LocalLLaMA lead source RecursiveSI Flint Benchmark: unsloth/flint-GGUF flint-UD-Q3_K_XL.gguf