Memory bandwidth limits observed on Intel Sapphire Rapids with DDR5-4800 RDIMMs; user reports ~36–40 GB/s vs theoretical 153 GB/s for DeepSeek-V4-Flash-0731 MoE workload
Read the original at old.reddit.com→I have a Xeon w7-3465 and 4 sticks of RDIMM DDR5-4800 with a theoretical max bandwidth of 153GB/s. I am trying to run DeepSeek-V4-Flash-0731 as it is an MoE and the weights are in MXFP4, so I should roughly process...
Original headline: "Memory Bandwidth problems with Intel Sapphire Rapids"
Coverage timeline
- Aug 9, 04:41 UTC r/LocalLLaMA lead source Memory Bandwidth problems with Intel Sapphire Rapids