arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.12296cs.LGcs.AIcs.MM
收藏

原型有助于联邦学习:实现更快的融合

Prototype Helps Federated Learning: Towards Faster Convergence

Kyung Hee University(庆熙大学)

Yu Qiao, Seong-Bae Park, Sun Moo Kang, Choong Seon Hong

摘要:

联邦学习(FL)是一种分布式机器学习技术,其中多个客户端合作训练共享模型,而无需交换其原始数据。然而,客户端之间的数据分布的异构性通常会导致模型推理效果不佳。本文提出了一种基于原型的联邦学习框架,该框架只需对典型联邦学习过程的最后一次全局迭代进行少量修改,就可以获得更好的推理性能。在最后一次迭代中,服务器聚集从分布式客户端传输的原型,然后将它们发送回本地客户端,以进行各自的模型推理。在两个基线数据集上的实验表明,在不同的异构环境下,我们的建议可以实现更高的准确性(至少1%)和相对有效的通信比两个流行的基线。

英文摘要:

Federated learning (FL) is a distributed machine learning technique in which multiple clients cooperate to train a shared model without exchanging their raw data. However, heterogeneity of data distribution among clients usually leads to poor model inference. In this paper, a prototype-based federated learning framework is proposed, which can achieve better inference performance with only a few changes to the last global iteration of the typical federated learning process. In the last iteration, the server aggregates the prototypes transmitted from distributed clients and then sends them back to local clients for their respective model inferences. Experiments on two baseline datasets show that our proposal can achieve higher accuracy (at least 1%) and relatively efficient communication than two popular baselines under different heterogeneous settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑