arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.09014cs.LGcs.MA
收藏

基于特征的联邦迁移学习:通信效率、鲁棒性与隐私

Feature-based Federated Transfer Learning: Communication Efficiency, Robustness and Privacy

Syracuse University(雪城大学)

Feng Wang, M. Cenk Gursoy, Senem Velipasalar

AI总结:

该研究提出基于特征的联邦迁移学习方法,通过上传特征与输出替代参数更新大幅降低上行负载,同时分析其鲁棒性与隐私问题,并经多任务实验验证有效性。

摘要:

本文提出基于特征的联邦迁移学习这一新型方法,与现有联邦学习及联邦迁移学习方法相比,可将上行链路负载降低多个数量级,从而提升通信效率。具体而言,在提出的基于特征的联邦学习中,我们设计上传提取的特征和输出,而非参数更新。针对该分布式学习模型,我们确定了所需负载,并与现有方案进行了对比。随后,我们分析了基于特征的联邦迁移学习在丢包、数据不足及量化场景下的鲁棒性。最后,我们通过定义并分析标签隐私泄露与特征隐私泄露,同时研究缓解方法,探讨了隐私相关问题。针对上述所有分析,我们通过图像分类任务和自然语言处理任务的实验评估了所提学习方案的性能,以证明其有效性。

英文摘要:

In this paper, we propose feature-based federated transfer learning as a novel approach to improve communication efficiency by reducing the uplink payload by multiple orders of magnitude compared to that of existing approaches in federated learning and federated transfer learning. Specifically, in the proposed feature-based federated learning, we design the extracted features and outputs to be uploaded instead of parameter updates. For this distributed learning model, we determine the required payload and provide comparisons with the existing schemes. Subsequently, we analyze the robustness of feature-based federated transfer learning against packet loss, data insufficiency, and quantization. Finally, we address privacy considerations by defining and analyzing label privacy leakage and feature privacy leakage, and investigating mitigating approaches. For all aforementioned analyses, we evaluate the performance of the proposed learning scheme via experiments on an image classification task and a natural language processing task to demonstrate its effectiveness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑