Skip to content
InfoResearchPreprint

Byzantine-Robust Muon: Resilient Momentum Orthogonalization for Distributed Learning

Published
Record updated
View JSON

Summary

This paper analyzes Byzantine-robust distributed and federated learning with the Muon optimizer, using a unified first-order trust-region framework and robust aggregation, without assuming i.i.d. data. It establishes convergence guarantees for non-convex and star-convex objectives, with an additive heterogeneity error floor. In simulated federated experiments on CIFAR-10, TinyStories and other benchmarks, the tested Muon configurations achieved higher attacked accuracy or lower perplexity than the tested baselines.