DuplexTune replays coupled hidden states to enable memory-efficient mixture-of-experts adaptation
Read the original at arxiv.org→arXiv:2610.36009v1 Announce Type: new Abstract: Sparse expert execution does not remove the stored states needed to adapt a mixture-of-experts language model. We present DuplexTune, a framework for replaying coupled...
Original headline: "DuplexTune: Coupled-State Replay for Memory-Efficient Mixture-of-Experts Adaptation"
Coverage timeline
- Oct 28, 04:00 UTC arXiv cs.LG lead source DuplexTune: Coupled-State Replay for Memory-Efficient Mixture-of-Experts Adaptation