arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0811.2595math.OC
收藏

凸优化的分布式随机次梯度投影算法

Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization

S. Sundhar Ram, A. Nedich, V. V. Veeravalli

摘要:

我们考虑一个分布式多智能体网络系统,其目标是最小化受一个共同的凸约束集的代理的凸目标函数的总和。每个代理维护一个重复序列,并将迭代传递给它的邻居。然后,每个代理将接收到的迭代的加权平均值与其自己的迭代次数相结合,并通过使用其自己的函数的次梯度信息(已知具有随机误差)和通过投影到约束集上来调整迭代次数。本文的目的是探讨随机次梯度误差对算法收敛性的影响。我们首先考虑算法的平均行为,然后以概率1和均方收敛。我们认为一般的随机误差,有一致有界的二阶矩,并获得的限制性能的算法,平均递减和非递减步长的界限。当误差的平均值减小时,我们证明了代理之间存在平均共识,并且平均收敛到最优函数值以减小步长。当平均误差足够快地减小时,我们将结果加强到一致性,并且迭代以概率1和均方收敛到最优解。

英文摘要:

We consider a distributed multi-agent network system where the goal is to minimize a sum of convex objective functions of the agents subject to a common convex constraint set. Each agent maintains an iterate sequence and communicates the iterates to its neighbors. Then, each agent combines weighted averages of the received iterates with its own iterate, and adjusts the iterate by using subgradient information (known with stochastic errors) of its own function and by projecting onto the constraint set. The goal of this paper is to explore the effects of stochastic subgradient errors on the convergence of the algorithm. We first consider the behavior of the algorithm in mean, and then the convergence with probability 1 and in mean square. We consider general stochastic errors that have uniformly bounded second moments and obtain bounds on the limiting performance of the algorithm in mean for diminishing and non-diminishing stepsizes. When the means of the errors diminish, we prove that there is mean consensus between the agents and mean convergence to the optimum function value for diminishing stepsizes. When the mean errors diminish sufficiently fast, we strengthen the results to consensus and convergence of the iterates to an optimal solution with probability 1 and in mean square.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑