Mellum2.1-12B-A2.5B tested on PI Coding Agent; one-shot results mixed across tasks
Read the original at www.reddit.com→I tested Mellum2.1-12B-A2.5B (Q8) locally using Pi and llama-server. All five tests were one-shot. Results were pretty mixed: - Pelican SVG, Browser OS, Minecraft: Poor results. - Bouncing Hexagon: Physics were okay,...
Original headline: "Tested Mellum2.1-12B-A2.5B on PI Coding Agent - surprisingly usable, but not great at one-shot projects"
Coverage timeline
- Oct 9, 15:50 UTC r/LocalLLaMA lead source Tested Mellum2.1-12B-A2.5B on PI Coding Agent - surprisingly usable, but not great at one-shot projects