arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.08892cs.LGcs.AIcs.CR
收藏

Federated Learning在实践中的反思与展望

Federated Learning in Practice: Reflections and Projections

Google Research(谷歌研究院)

Katharine Daly, Hubert Eichner, Peter Kairouz, H. Brendan McMahan, Daniel Ramage, Zheng Xu

AI总结:

本文回顾了Federated Learning(FL)的进展与挑战,提出优先考虑隐私原则的重新定义的FL框架,并利用可信执行环境和开源生态系统规划未来发展路径。

摘要:

Federated Learning(FL,联邦学习)是一种机器学习技术,允许多个实体在不交换本地数据的情况下协作学习共享模型。过去十年中,FL系统取得了显著进展,扩展至跨多个学习域的数百万台设备,同时提供有意义的差分隐私(DP)保证。Google、Apple和Meta等机构的生产系统证明了FL在现实世界中的适用性。然而,关键挑战依然存在,包括验证服务器端DP保证以及协调异构设备间的训练,这限制了更广泛的应用。此外,大型(多模态)模型等新兴趋势,以及训练、推理和个性化之间界限的模糊,对传统FL框架构成了挑战。为此,我们提出了一种重新定义的FL框架,优先考虑隐私原则而非僵化的定义。我们还通过利用可信执行环境和开源生态系统来规划前进路径,以应对这些挑战并促进FL的未来发展。

英文摘要:

Federated Learning (FL) is a machine learning technique that enables multiple entities to collaboratively learn a shared model without exchanging their local data. Over the past decade, FL systems have achieved substantial progress, scaling to millions of devices across various learning domains while offering meaningful differential privacy (DP) guarantees. Production systems from organizations like Google, Apple, and Meta demonstrate the real-world applicability of FL. However, key challenges remain, including verifying server-side DP guarantees and coordinating training across heterogeneous devices, limiting broader adoption. Additionally, emerging trends such as large (multi-modal) models and blurred lines between training, inference, and personalization challenge traditional FL frameworks. In response, we propose a redefined FL framework that prioritizes privacy principles rather than rigid definitions. We also chart a path forward by leveraging trusted execution environments and open-source ecosystems to address these challenges and facilitate future advancements in FL.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑