OMP-MoE: Efficient expert pruning for Mixture-of-Experts LLMs via orthogonal matching pursuit
Read the original at arxiv.org→arXiv:2609.31631v1 Announce Type: new Abstract: Mixture-of-Experts (MoE) models enable efficient scaling of large language models but face critical deployment challenges due to massive memory requirements. Existing...
Original headline: "OMP-MoE: Efficient Expert Pruning for Mixture-of-Experts LLMs via Orthogonal Matching Pursuit"
Coverage timeline
- Sep 29, 04:00 UTC arXiv cs.LG lead source OMP-MoE: Efficient Expert Pruning for Mixture-of-Experts LLMs via Orthogonal Matching Pursuit