Matching the training-time weight rule in inference-time expert deactivation
Read the original at arxiv.org→arXiv:2611.05804v1 Announce Type: new Abstract: Expert deactivation at inference time changes both token routing and expert weights, and its effect on performance depends on how these changes are implemented. We...
Original headline: "Matching the Training-Time Weight Rule in Inference-Time Expert Deactivation"
Coverage timeline
- Nov 5, 05:00 UTC arXiv cs.CL lead source Matching the Training-Time Weight Rule in Inference-Time Expert Deactivation