Skip to content
InfoResearchPeer-reviewed

Momentum-Based Zeroth-Order Gradient Method for Distributed Black-Box Optimization

Published
Record updated
View JSON

Summary

Researchers study distributed black-box optimization, where client objective functions can only be queried, and address slow convergence caused by data heterogeneity and high gradient-estimate variance. They propose DZO-SNGM, a distributed zeroth-order stochastic normalized gradient descent method with momentum, which runs multiple local zeroth-order updates per client, aggregates models globally, and applies one stabilizing momentum update on the server. Experiments on image classification and distributed black-box adversarial attacks report faster convergence and better final performance than state-of-the-art methods.