Trace-driven evaluation can mislead MoE expert caching due to replay semantics, workload contamination, and operating regimes.
Read the original at arxiv.org→arXiv:2608.07911v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models have outgrown accelerator memory, and offloading expert weights to host memory is now standard. This makes expert cache management an...
Original headline: "When Does Trace-Driven Evaluation Mislead MoE Expert Caching? Replay Semantics, Workload Contamination, and Operating Regimes"
Coverage timeline
- Aug 11, 04:00 UTC arXiv cs.LG lead source When Does Trace-Driven Evaluation Mislead MoE Expert Caching? Replay Semantics, Workload Contamination, and Operating Regimes