Meta Expert: Cross-layer expert sharing for storage- and retrieval-efficient MoE

As model parameters scale up, sparsely activated Mixture-of-Experts (MoE) approaches have become essential for model scaling. However, mainstream models currently adopt hierarchical architectures, where experts in...