SpecDrop: parameter-free routing for modular specialization in mixture-of-experts networks
Read the original at arxiv.org→arXiv:2608.04084v1 Announce Type: new Abstract: Mixture-of-experts (MoE) networks pursue specialization through learned routers, gates, and load-balancing losses, yet at matched total-parameter budgets learned...
Original headline: "SpecDrop: Parameter-Free Category-Conditioned Routing for Modular Specialization"
Coverage timeline
- Aug 6, 04:00 UTC arXiv cs.LG lead source SpecDrop: Parameter-Free Category-Conditioned Routing for Modular Specialization