Qwen 3.8-Flash-Next IQ3_XXS with MoEShift: M5 Pro outperforms M4 Pro on long prompts and decoding speed; peak memory 8.5 GB
Read the original at www.reddit.com→I benchmarked Qwen3.8-Flash-Next 125B ISTA-DASLab's GSQ-RCO IQ3_XXS quant (76GB on disk), on two Macs with 24GB unified memory using MoEShift backend: Metric M4 Pro (medians) M5 Pro (medians) Short prompt decode...
Original headline: "M4 Pro vs M5 Pro (24GB): Qwen 3.8 Flash Next IQ3 with MoEShift at 374 tok/s prefill, 14.7 tok/s decode, 8.5GB peak memory"
Coverage timeline
- Nov 9, 12:10 UTC r/LocalLLaMA lead source M4 Pro vs M5 Pro (24GB): Qwen 3.8 Flash Next IQ3 with MoEShift at 374 tok/s prefill, 14.7 tok/s decode, 8.5GB peak memory