arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.03703cs.CV
收藏

基于半监督联邦对等学习的皮肤病变分类

Semi-Supervised Federated Peer Learning for Skin Lesion Classification

Technical University of Munich(慕尼黑工业大学);Johns Hopkins University(约翰斯·霍普金斯大学);University Hospital Bonn(波恩大学医院);Helmholtz Zentrum München(亥姆霍兹慕尼黑中心)

Tariq Bdair, Nassir Navab, Shadi Albarqouni

摘要:

在全球范围内,皮肤癌是最致命的疾病之一。每年有数百万人被诊断出患有这种癌症。因此,早期发现可以大大降低药物费用和死亡率。最近使用深度学习方法的自动癌症分类的改进已经达到了人类水平的性能,需要在一个位置组装大量的注释数据,然而,找到这样的条件通常是不可行的。最近,联邦学习(FL)已被提出来训练分散的模型在隐私保护的方式依赖于标记的数据在客户端,这通常是不可用的和昂贵的。为了解决这个问题,我们提出了\verb!FedPerl!,一种半监督联邦学习方法。我们的方法受到教育心理学的同伴学习和委员会机器的整体平均的启发。FedPerl基于客户端的相似性构建社区。然后,它鼓励社区成员相互学习,为未标记的数据生成更准确的伪标签。我们还提出了对等匿名化(PA)技术来匿名客户端。作为该方法的核心部分,PA与其他方法正交而不增加复杂度,在提高性能的同时降低了通信成本。最后,我们提出了一个动态的同行学习策略,控制学习流,以避免任何性能下降,特别是对个人客户端。我们的实验设置包括从5个公开数据集收集的71,000张皮肤病变图像。我们测试我们的方法在四个不同的场景中SSFL。在几乎没有注释数据的情况下,FedPerl在标准设置中的皮肤病变分类方面与最先进的方法不相上下,同时分别比SSFL和基线高出1.8%和15.8%。此外,它更好地推广到看不见的客户端,同时对嘈杂的客户端不太敏感。

英文摘要:

Globally, Skin carcinoma is among the most lethal diseases. Millions of people are diagnosed with this cancer every year. Sill, early detection can decrease the medication cost and mortality rate substantially. The recent improvement in automated cancer classification using deep learning methods has reached a human-level performance requiring a large amount of annotated data assembled in one location, yet, finding such conditions usually is not feasible. Recently, federated learning (FL) has been proposed to train decentralized models in a privacy-preserved fashion depending on labeled data at the client-side, which is usually not available and costly. To address this, we propose \verb!FedPerl!, a semi-supervised federated learning method. Our method is inspired by peer learning from educational psychology and ensemble averaging from committee machines. FedPerl builds communities based on clients' similarities. Then it encourages communities members to learn from each other to generate more accurate pseudo labels for the unlabeled data. We also proposed the peer anonymization (PA) technique to anonymize clients. As a core component of our method, PA is orthogonal to other methods without additional complexity and reduces the communication cost while enhancing performance. Finally, we propose a dynamic peer-learning policy that controls the learning stream to avoid any degradation in the performance, especially for individual clients. Our experimental setup consists of 71,000 skin lesion images collected from 5 publicly available datasets. We test our method in four different scenarios in SSFL. With few annotated data, FedPerl is on par with a state-of-the-art method in skin lesion classification in the standard setup while outperforming SSFLs and the baselines by 1.8% and 15.8%, respectively. Also, it generalizes better to unseen clients while being less sensitive to noisy ones.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑