arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2207.03448cs.LG
收藏

高度非独立同异的联邦学习中的自适应个性化。数据

Adaptive Personlization in Federated Learning for Highly Non-i.i.d. Data

Technical University of Munich(慕尼黑工业大学);Johns Hopkins University(约翰斯·霍普金斯大学)

Yousef Yeganeh, Azade Farshad, Johann Boschmann, Richard Gaus, Maximilian Frantzen, Nassir Navab

摘要:

联邦学习(FL)是一种分布式学习方法,为医疗机构提供了在全球模型中进行协作的前景,同时保护了患者的隐私。尽管大多数医疗中心执行类似的医学成像任务,但它们的差异(如专业化、患者数量和设备)导致了独特的数据分布。数据异构性对FL和本地模型的个性化提出了挑战。在这项工作中,我们研究了自适应层次聚类方法FL产生中间半全球模型,使客户端具有类似的数据分布有机会形成一个更专业的模型。我们的方法形成了几个集群组成的客户端最相似的数据分布,然后,每个集群继续单独训练。在集群内部,我们使用元学习来提高参与者模型的个性化。我们比较了聚类方法与经典的FedAvg和集中式训练,通过评估我们提出的方法对HAM10k数据集的皮肤病变分类与极端异构的数据分布。我们的实验表明,显着的性能增益在异构分布相比,标准FL方法的分类精度。此外,我们表明,如果应用于集群,模型收敛速度更快,并且在仅使用一小部分数据的情况下优于集中式训练。

英文摘要:

Federated learning (FL) is a distributed learning method that offers medical institutes the prospect of collaboration in a global model while preserving the privacy of their patients. Although most medical centers conduct similar medical imaging tasks, their differences, such as specializations, number of patients, and devices, lead to distinctive data distributions. Data heterogeneity poses a challenge for FL and the personalization of the local models. In this work, we investigate an adaptive hierarchical clustering method for FL to produce intermediate semi-global models, so clients with similar data distribution have the chance of forming a more specialized model. Our method forms several clusters consisting of clients with the most similar data distributions; then, each cluster continues to train separately. Inside the cluster, we use meta-learning to improve the personalization of the participants' models. We compare the clustering approach with classical FedAvg and centralized training by evaluating our proposed methods on the HAM10k dataset for skin lesion classification with extreme heterogeneous data distribution. Our experiments demonstrate significant performance gain in heterogeneous distribution compared to standard FL methods in classification accuracy. Moreover, we show that the models converge faster if applied in clusters and outperform centralized training while using only a small subset of data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑