arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.08263cs.LGmath.OCstat.ML
收藏

多人联邦学习:以更少通信达到均衡

Multiplayer Federated Learning: Reaching Equilibrium with Less Communication

Department of Applied Mathematics & Statistics(应用数学与统计学系);Mathematical Institute for Data Science(数据科学数学研究所);Johns Hopkins University(约翰霍普金斯大学)

TaeHo Yoon, Sayantan Choudhury, Nicolas Loizou

AI总结:

本文提出多人联邦学习框架MpFL,将客户端建模为博弈参与者,并设计PEARL-SGD算法,以更少通信达到均衡邻域。

摘要:

传统的联邦学习(FL)方法假设客户端是协作的,目标一致,共同致力于一个共享的全局模型。然而,在许多现实场景中,客户端表现为具有各自目标和策略行为的理性参与者,而现有FL框架无法充分应对这一概念。为弥合这一差距,我们提出了多人联邦学习(Multiplayer Federated Learning,MpFL),这是一个新颖的框架,将FL环境中的客户端建模为博弈论背景下的参与者,旨在达到均衡。在这种场景下,每个参与者都试图优化自己的效用函数,该效用函数可能与集体目标不一致。在MpFL框架内,我们提出了逐参与者局部随机梯度下降(Per-Player Local Stochastic Gradient Descent,PEARL-SGD)算法,在该算法中,每个参与者/客户端独立执行局部更新,并周期性地与其他参与者通信。我们从理论上分析了PEARL-SGD,并证明在随机设置下,与其非局部对应方法相比,该算法能以更少的通信达到均衡的邻域。最后,我们通过数值实验验证了我们的理论发现。

英文摘要:

Traditional Federated Learning (FL) approaches assume collaborative clients with aligned objectives working towards a shared global model. However, in many real-world scenarios, clients act as rational players with individual objectives and strategic behaviors, a concept that existing FL frameworks are not equipped to adequately address. To bridge this gap, we introduce Multiplayer Federated Learning (MpFL), a novel framework that models the clients in the FL environment as players in a game-theoretic context, aiming to reach an equilibrium. In this scenario, each player tries to optimize their own utility function, which may not align with the collective goal. Within MpFL, we propose Per-Player Local Stochastic Gradient Descent (PEARL-SGD), an algorithm in which each player/client performs local updates independently and periodically communicates with other players. We theoretically analyze PEARL-SGD and prove that it reaches a neighborhood of equilibrium with less communication in the stochastic setup compared to its non-local counterpart. Finally, we verify our theoretical findings through numerical experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑