arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.01387cs.LGcs.DC
收藏

联邦迁移学习综合综述:挑战、方法与应用

A Comprehensive Survey of Federated Transfer Learning: Challenges, Methods and Applications

Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);School of Computer Science and Technology, Shandong University(山东大学计算机科学与技术学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);Beijing Academy of Blockchain and Edge Computing(北京区块链与边缘计算研究院)

Wei Guo, Fuzhen Zhuang, Xiao Zhang, Yiqi Tong, Jin Dong

AI总结:

本文综述联邦迁移学习,针对FL中的分布、系统异构、增量数据与标注稀缺等挑战,分类梳理FTL方法、解决方案、应用、场景设定、数据集及相关研究。

摘要:

联邦学习(FL)是一种新型分布式机器学习范式,它通过消除数据共享需求,使参与者能够在保护隐私的前提下协同训练一个中心化模型。在实践中,FL通常涉及多个参与者,并需要第三方聚合全局信息以指导目标参与者的更新。因此,许多FL方法效果不佳,因为各参与者的训练数据和测试数据可能并非采样自相同的特征空间和相同的底层分布。同时,其本地设备的差异(系统异构性)、在线数据的持续涌入(增量数据)以及标注数据稀缺,可能进一步影响这些方法的性能。为解决这一问题,将迁移学习(TL)融入FL的联邦迁移学习(FTL)吸引了众多研究者的关注。然而,由于FL使参与者能够在每个通信轮次之间持续共享知识,同时不允许其他参与者访问本地数据,FTL面临许多TL中不存在的独特挑战。在本综述中,我们重点对联邦迁移学习的最新进展进行分类和评述,并概述相应的解决方案与应用。此外,本综述还总结了FTL场景的常见设定、可用数据集以及重要的相关研究。

英文摘要:

Federated learning (FL) is a novel distributed machine learning paradigm that enables participants to collaboratively train a centralized model with privacy preservation by eliminating the requirement of data sharing. In practice, FL often involves multiple participants and requires the third party to aggregate global information to guide the update of the target participant. Therefore, many FL methods do not work well due to the training and test data of each participant may not be sampled from the same feature space and the same underlying distribution. Meanwhile, the differences in their local devices (system heterogeneity), the continuous influx of online data (incremental data), and labeled data scarcity may further influence the performance of these methods. To solve this problem, federated transfer learning (FTL), which integrates transfer learning (TL) into FL, has attracted the attention of numerous researchers. However, since FL enables a continuous share of knowledge among participants with each communication round while not allowing local data to be accessed by other participants, FTL faces many unique challenges that are not present in TL. In this survey, we focus on categorizing and reviewing the current progress on federated transfer learning, and outlining corresponding solutions and applications. Furthermore, the common setting of FTL scenarios, available datasets, and significant related research are summarized in this survey.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑