DDR4/PCIe4 vs DDR5/PCIe5 for LLM pre-training: a benchmarking comparison for AI workstations
Read the original at www.reddit.com→Hello everyone. I've recently ran some experiments comparing DDR4/PCIe4 and DDR5/PCIe5 for AI workstations on a pre-training run, and would like to hear yours thoughts. First of all, and as a summary of my results (...
Original headline: "DDR4/PCIe4 vs DDR5/PCIe5 for LLMs- I benchmarked them for pre-training. What are your thoughts?"
Coverage timeline
- Oct 1, 20:42 UTC r/LocalLLaMA lead source DDR4/PCIe4 vs DDR5/PCIe5 for LLMs- I benchmarked them for pre-training. What are your thoughts?