arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.07671cs.LG
收藏

在分布偏移和漂移下基于轮廓映射的联邦学习

Federated Learning with Profile Mapping under Distribution Shifts and Drifts

Università della Svizzera italiana(瑞士意大利大学)

Mohan Li, Dario Fenoglio, Martin Gjoreski, Marc Langheinrich

AI总结:

Feroma通过基于客户端分布轮廓的自适应加权方法,在数据分布偏移和漂移下提升联邦学习的性能和稳定性。

摘要:

联邦学习(FL)能够在不共享原始数据的情况下,在客户端之间进行去中心化的模型训练,但其性能在现实世界的数据异质性下会下降。现有方法往往无法解决客户端之间的分布偏移和时间上的分布漂移,或者依赖于不现实的假设,如已知的客户端集群数量和数据异质性类型,这限制了它们的通用性。我们引入了Feroma,一种新的FL框架,该框架明确处理分布偏移和漂移,而无需依赖客户端或集群身份。Feroma基于客户端分布轮廓-紧凑、隐私保护的本地数据表示-通过自适应相似性加权来指导模型聚合和测试时的模型分配。这种设计使Feroma能够在训练过程中动态选择聚合策略,从集群化到个性化,并在无需重新训练、在线适应或先验知识的情况下,为未见过的、未标记的测试客户端部署合适的模型。广泛的实验表明,与10种最先进的方法相比,Feroma在动态数据异质性条件下提高了性能和稳定性-在六个基准测试中,相对于最佳基线,平均准确率提高了最高12个百分点-同时保持计算和通信开销与FedAvg相当。这些结果表明,基于分布轮廓的聚合为在数据分布偏移和漂移下实现稳健的FL提供了一条实际路径。

英文摘要:

Federated Learning (FL) enables decentralized model training across clients without sharing raw data, but its performance degrades under real-world data heterogeneity. Existing methods often fail to address distribution shift across clients and distribution drift over time, or they rely on unrealistic assumptions such as known number of client clusters and data heterogeneity types, which limits their generalizability. We introduce Feroma, a novel FL framework that explicitly handles both distribution shift and drift without relying on client or cluster identity. Feroma builds on client distribution profiles-compact, privacy-preserving representations of local data-that guide model aggregation and test-time model assignment through adaptive similarity-based weighting. This design allows Feroma to dynamically select aggregation strategies during training, ranging from clustered to personalized, and deploy suitable models to unseen, and unlabeled test clients without retraining, online adaptation, or prior knowledge on clients' data. Extensive experiments show that compared to 10 state-of-the-art methods, Feroma improves performance and stability under dynamic data heterogeneity conditions-an average accuracy gain of up to 12 percentage points over the best baselines across 6 benchmarks-while maintaining computational and communication overhead comparable to FedAvg. These results highlight that distribution-profile-based aggregation offers a practical path toward robust FL under both data distribution shifts and drifts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑