M5 Ultra 256 runs GLM 5.3 at 68.8 tokens per second; benchmarks and prefill stats noted
Read the original at www.reddit.com→Running oQ4e+MTP on oMLX 0.7.0, with still more to optimize. Prefill is 1,878 toks. I saw some other benchmarks below what id expect so i figured I would share. submitted by /u/cryotic [link] [comments]
Original headline: "M5 Ultra 256 running GLM 5.3 Flash 68.8 tok/s"
Coverage timeline
- Oct 5, 13:27 UTC r/LocalLLaMA lead source M5 Ultra 256 running GLM 5.3 Flash 68.8 tok/s