arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01633cs.CV
收藏

联邦视觉Transformer与自适应焦点损失用于医学图像分类

Federated Vision Transformer with Adaptive Focal Loss for Medical Image Classification

School of Artificial Intelligence, Guilin University of Electronic Technology, Guilin, China, 541004(桂林电子科技大学人工智能学院);The Laboratory for Imagery, Vision and Artificial Intelligence, École de Technologie Supérieure, Montreal, Canada, H3C 1K3(影像、视觉与人工智能实验室);College of Medicine, Taibah University, Al Madinah, Saudi Arabia, 42353(塔布大学医学院);Department of Radiology, Prince Mohammed Bin Abdulaziz Hospital, Ministry of National Guard Health Affairs, Al Madinah, Saudi Arabia, 42324(王子穆罕默德·本·阿卜杜勒阿齐兹医院放射科);College of Computer Science and Engineering, Taibah University, Madinah, Saudi Arabia, 42353(塔布大学计算机科学与工程学院);Engineering, Jeddah University, Jeddah, Saudi Arabia, 23445(吉达大学工程学院)

Xinyuan Zhao, Yihang Wu, Ahmad Chaddad, Tareef Daqqaq, Reem Kateb

AI总结:

本研究提出一种结合动态自适应焦点损失和客户端感知聚合策略的联邦学习框架,提升医学图像分类的准确率。

摘要:

尽管深度学习模型如视觉Transformer(ViT)已取得显著进展,但它们通常需要大量数据集。随着数据隐私法规的实施,许多原始数据集的访问受到限制,尤其是在医学图像方面。联邦学习(FL)通过在不交换数据的情况下实现全局模型聚合来解决这一挑战。然而,本地客户端中的数据异质性和类别不平衡对模型的泛化能力构成了挑战。本研究提出了一种利用动态自适应焦点损失(DAFL)和客户端感知聚合策略的FL框架,用于本地训练。具体而言,我们设计了一个动态类别不平衡系数,该系数根据每个客户端的样本分布和类别数据分布进行调整,确保少数类获得足够的关注,并防止稀疏数据被忽略。为了解决客户端异质性问题,采用了加权聚合策略,该策略适应数据大小和特征,以更好地捕捉客户端之间的变化。在三个公共数据集(ISIC、眼科疾病和RSNA-ICH)上的分类结果表明,所提出的框架在大多数情况下优于DenseNet121、ResNet50、ViT-S/16、ViT-L/32、FedCLIP、Swin Transformer、CoAtNet和MixNet,准确率提高了0.98%至41.69%。对不平衡ISIC数据集的消融研究验证了所提损失函数和聚合策略的有效性,与传统损失函数和其他FL方法相比。代码可在:https://github.com/AIPMLab/ViT-FLDAF上找到。

英文摘要:

While deep learning models like Vision Transformer (ViT) have achieved significant advances, they typically require large datasets. With data privacy regulations, access to many original datasets is restricted, especially medical images. Federated learning (FL) addresses this challenge by enabling global model aggregation without data exchange. However, the heterogeneity of the data and the class imbalance that exist in local clients pose challenges for the generalization of the model. This study proposes a FL framework leveraging a dynamic adaptive focal loss (DAFL) and a client-aware aggregation strategy for local training. Specifically, we design a dynamic class imbalance coefficient that adjusts based on each client's sample distribution and class data distribution, ensuring minority classes receive sufficient attention and preventing sparse data from being ignored. To address client heterogeneity, a weighted aggregation strategy is adopted, which adapts to data size and characteristics to better capture inter-client variations. The classification results on three public datasets (ISIC, Ocular Disease and RSNA-ICH) show that the proposed framework outperforms DenseNet121, ResNet50, ViT-S/16, ViT-L/32, FedCLIP, Swin Transformer, CoAtNet, and MixNet in most cases, with accuracy improvements ranging from 0.98\% to 41.69\%. Ablation studies on the imbalanced ISIC dataset validate the effectiveness of the proposed loss function and aggregation strategy compared to traditional loss functions and other FL approaches. The codes can be found at: https://github.com/AIPMLab/ViT-FLDAF.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑