Datapoint: 2x M5U cluster (GLM/Qwen) with 256GB, 80 cores each; user shares setup caveats and performance figures for prefill and decode tokens
Read the original at www.reddit.com→Caveats: IDK how to set anything up and I asked Deepseek to handle it - not enough training data so without specific guides the set up doesn't work well. I'm not a programmer. My previous model was Qwen 3.8 27B q4...
Original headline: "datapoint: 2x M5U cluster (GLM/Qwen)"
Coverage timeline
- Oct 26, 14:26 UTC r/LocalLLaMA lead source datapoint: 2x M5U cluster (GLM/Qwen)