arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.08665cs.RO
收藏

DiNNO:多机器人协作学习的分布式神经网络优化

DiNNO: Distributed Neural Network Optimization for Multi-Robot Collaborative Learning

Stanford University(斯坦福大学)

Javier Yu, Joseph A. Vincent, Mac Schwager

摘要:

我们提出了一种分布式算法,使一组机器人协作优化的参数,同时通过网状网络进行通信的深度神经网络模型。每个机器人只能访问自己的数据,并维护自己版本的神经网络,但最终学习的模型就像是在所有数据上集中训练的一样好。没有机器人通过无线网络发送原始数据,保护数据隐私并确保无线带宽的有效使用。在每次迭代中,每个机器人近似地优化一个增广拉格朗日函数,然后将得到的权重传递给它的邻居,更新对偶变量,然后重复。最终,所有机器人的局部网络权重达成共识。对于凸目标函数,我们证明了这种共识是一个全局最优。我们将我们的算法与两种现有的分布式深度神经网络训练算法进行了比较:(i)MNIST图像分类任务,(ii)多机器人隐式映射任务,以及(iii)多机器人强化学习任务。在我们所有的实验中,我们的方法都超过了基线,并且能够实现与集中训练模型相当的验证损失。请参阅\href{https://msl.stanford.edu/projects/dist_nn_train}{https://msl.stanford.edu/projects/dist\_nn\_train}获取视频和GitHub存储库的链接。

英文摘要:

We present a distributed algorithm that enables a group of robots to collaboratively optimize the parameters of a deep neural network model while communicating over a mesh network. Each robot only has access to its own data and maintains its own version of the neural network, but eventually learns a model that is as good as if it had been trained on all the data centrally. No robot sends raw data over the wireless network, preserving data privacy and ensuring efficient use of wireless bandwidth. At each iteration, each robot approximately optimizes an augmented Lagrangian function, then communicates the resulting weights to its neighbors, updates dual variables, and repeats. Eventually, all robots' local network weights reach a consensus. For convex objective functions, we prove this consensus is a global optimum. We compare our algorithm to two existing distributed deep neural network training algorithms in (i) an MNIST image classification task, (ii) a multi-robot implicit mapping task, and (iii) a multi-robot reinforcement learning task. In all of our experiments our method out performed baselines, and was able to achieve validation loss equivalent to centrally trained models. See \href{https://msl.stanford.edu/projects/dist_nn_train}{https://msl.stanford.edu/projects/dist\_nn\_train} for videos and a link to our GitHub repository.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑