Benched a 124B on one DGX Spark for a week and published results; 38.7 tok/s on the fastest path found, 2.4x DeepSeek V4 Flash on the same box
Read the original at old.reddit.com→sudoingX on X spent a week on this and posted his wrap-up. The hardware is his. He isn't affiliated with us and we didn't see any of it before he put it out — I work on Ling at inclusionAI. Where he landed on one...
Original headline: "Benched a 124B on one DGX Spark for a week and published all of it — 38.7 tok/s on the fastest path he found, 2.4x DeepSeek V4 Flash on the same box"
Coverage timeline
- Aug 12, 16:34 UTC r/LocalLLaMA lead source Benched a 124B on one DGX Spark for a week and published all of it — 38.7 tok/s on the fastest path he found, 2.4x DeepSeek V4 Flash on the same box