Hierarchical Copula-Gumbel-Top-K routing: two-sided dependence control for frozen mixture-of-experts at fixed per-token routing laws
Read the original at arxiv.org→arXiv:2607.28670v1 Announce Type: new Abstract: A stochastic Gumbel-Top-$K$ router defines, for every token of a mixture-of-experts (MoE) model, a \emph{routing law}: a distribution over ordered expert lists and...
Original headline: "Hierarchical Copula-Gumbel-Top-\texorpdfstring{$K$}{K} Routing: Two-Sided Dependence Control for Frozen Mixture-of-Experts at Fixed Per-Token Routing Laws"
Coverage timeline
- Aug 3, 04:00 UTC arXiv cs.LG lead source Hierarchical Copula-Gumbel-Top-\texorpdfstring{$K$}{K} Routing: Two-Sided Dependence Control for Frozen Mixture-of-Experts at Fixed Per-Token Routing Laws