Byzantine-Robust Muon: Resilient Momentum Orthogonalization for Distributed Learning

arXiv:2611.13137v1 Announce Type: new Abstract: Optimization methods, including the Muon optimizer based on the Linear Minimization Oracle (LMO) and momentum orthogonalization, have shown strong empirical...