arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.12995cs.LGcs.CV
收藏

FedFA:联合特征增强

FedFA: Federated Feature Augmentation

ETH Zurich(苏黎世联邦理工学院)

Tianfei Zhou, Ender Konukoglu

摘要:

联邦学习是一种分布式范例,允许多方协作训练深度模型,而无需交换原始数据。然而,客户端之间的数据分布自然是非i.i.d.的,这导致学习模型的严重退化。本文的主要目标是开发一个鲁棒的联邦学习算法来解决客户样本中的特征偏移,这可能是由各种因素引起的,例如,医学成像中的采集差异。为了实现这一目标,我们提出FedFA从联邦特征增强的不同角度来解决联邦学习。FedFA基于一个主要的见解,即每个客户端的数据分布可以通过统计来表征(即,平均值和标准偏差);并且可能全局地操纵这些局部统计,即,基于整个联邦中的信息,让客户更好地了解底层分布,从而减轻局部数据偏差。基于这一见解,我们建议基于正态分布概率地增强每个局部特征统计,其均值是原始统计,方差量化增强范围。我们的方法的关键是确定一个有意义的高斯方差,这是通过不仅考虑每个客户端的偏差数据,而且还考虑所有参与客户端的基本特征统计来实现的。我们提供了理论和经验的理由来验证FedFA的有效性。我们的代码可在https://github.com/tfzhou/FedFA上获得。

英文摘要:

Federated learning is a distributed paradigm that allows multiple parties to collaboratively train deep models without exchanging the raw data. However, the data distribution among clients is naturally non-i.i.d., which leads to severe degradation of the learnt model. The primary goal of this paper is to develop a robust federated learning algorithm to address feature shift in clients' samples, which can be caused by various factors, e.g., acquisition differences in medical imaging. To reach this goal, we propose FedFA to tackle federated learning from a distinct perspective of federated feature augmentation. FedFA is based on a major insight that each client's data distribution can be characterized by statistics (i.e., mean and standard deviation) of latent features; and it is likely to manipulate these local statistics globally, i.e., based on information in the entire federation, to let clients have a better sense of the underlying distribution and therefore alleviate local data bias. Based on this insight, we propose to augment each local feature statistic probabilistically based on a normal distribution, whose mean is the original statistic and variance quantifies the augmentation scope. Key to our approach is the determination of a meaningful Gaussian variance, which is accomplished by taking into account not only biased data of each individual client, but also underlying feature statistics characterized by all participating clients. We offer both theoretical and empirical justifications to verify the effectiveness of FedFA. Our code is available at https://github.com/tfzhou/FedFA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑