Adaptive-depth mixture-of-experts with learned halting enables dynamic compute in elastic inference
Read the original at arxiv.org→arXiv:2611.08741v1 Announce Type: new Abstract: Most LLM architectures have fixed compute demands determined at training time. We propose a novel architecture that combines the Mixture-of-Experts architecture with...
Original headline: "AlterNet: Adaptive-Depth Mixture-of-Experts with Learned Halting for Elastic Inference"
Coverage timeline
- Nov 9, 05:00 UTC arXiv cs.AI lead source AlterNet: Adaptive-Depth Mixture-of-Experts with Learned Halting for Elastic Inference