Overclocking DDR5 yields modest gains for MoE prefill and decode in llama.cpp with SYCL on Intel B70 32GB
Read the original at www.reddit.com→With llama.cpp using a customized SYCL backend on Intel B70 (32GB), overclocking my DDR5 memory gave modest gains for MoE models which do not fit in VRAM. Both PP and TG increased after overclocking DDR5. I've never...
Original headline: "Overclocking DDR5 For Faster MoE Prefill and Decode"
Coverage timeline
- Oct 6, 05:51 UTC r/LocalLLaMA lead source Overclocking DDR5 For Faster MoE Prefill and Decode