Reconstruction-optimized expert pruning for mixture-of-experts language models
Read the original at arxiv.org→arXiv:2610.27123v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models reduce computation through sparse expert activation, but deployment still requires storing a large number of expert parameters. We...
Original headline: "Reconstruction-Optimized Expert Pruning for Mixture-of-Experts Language Models"
Coverage timeline
- Oct 21, 04:00 UTC arXiv cs.LG lead source Reconstruction-Optimized Expert Pruning for Mixture-of-Experts Language Models